Jul 10 16:36:19.298212 ip-10-0-137-50 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 16:36:19.712358 ip-10-0-137-50 systemd[1]: Started Kubernetes Kubelet.
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.638775    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642232    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642245    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642248    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642251    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642254    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642257    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642259    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 16:36:19.727300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642263    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642266    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642269    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642272    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642275    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642277    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642280    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642283    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642286    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642289    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642291    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642294    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642297    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642300    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642303    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642305    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642308    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642316    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642319    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642322    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 16:36:19.728257 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642325    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642328    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642330    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642333    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642335    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642338    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642341    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642343    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642346    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642348    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642351    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642353    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642356    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642358    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642361    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642363    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642366    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642368    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642371    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642373    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 16:36:19.729247 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642376    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642379    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642381    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642384    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642387    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642389    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642392    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642395    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642397    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642401    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642403    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642407    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642409    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642412    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642414    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642416    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642419    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642422    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642424    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642427    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 16:36:19.729835 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642430    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642433    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642435    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642439    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642443    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642446    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642450    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642453    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642457    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642459    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642462    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642464    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642467    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642470    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642473    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642475    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642478    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642480    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642483    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 16:36:19.730786 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642486    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642488    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642491    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642494    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642497    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642500    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642503    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642507    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642511    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642513    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642516    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642519    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.642522    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644535    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644543    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644547    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644551    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644554    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644557    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 16:36:19.731607 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644560    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644563    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644567    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644571    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644574    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644577    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644580    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644583    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644587    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644590    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644592    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644595    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644597    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644600    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644602    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644606    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644609    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644611    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644614    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644617    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 16:36:19.732568 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644619    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644622    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644624    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644627    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644630    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644632    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644635    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644638    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644640    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644643    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644645    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644648    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644650    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644653    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644656    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644658    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644660    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644671    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644675    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644678    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 16:36:19.733703 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644681    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644684    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644687    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644689    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644692    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644696    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644700    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644705    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644709    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644713    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644717    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644721    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644723    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644726    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644729    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644731    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644734    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644736    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644739    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644742    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 16:36:19.734684 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644744    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644748    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644750    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644754    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644757    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644759    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644762    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644765    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644768    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644770    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644773    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644776    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644778    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644782    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644787    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644790    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644794    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644796    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644799    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 16:36:19.735558 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644801    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644804    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644807    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644809    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644812    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644815    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644817    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644820    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644824    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644828    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644831    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644833    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644836    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.644838    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645247    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645252    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645255    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645260    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645264    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 16:36:19.736364 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645267    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645270    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645273    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645276    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645279    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645281    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645284    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645286    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645292    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645295    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645298    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645301    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645303    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645306    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645308    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645311    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645313    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645316    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645319    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645321    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 16:36:19.736917 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645323    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645326    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645328    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645331    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645333    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645336    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645339    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645342    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645344    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645349    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645351    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645354    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645356    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645359    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645361    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645364    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645367    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645369    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645372    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645374    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 16:36:19.737600 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645378    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645386    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645389    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645394    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645398    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645400    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645403    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645406    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645409    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645411    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645414    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645416    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645419    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645421    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645424    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645426    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645428    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645431    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645434    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 16:36:19.738627 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645436    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645438    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645442    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645445    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645448    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645450    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645453    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645455    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645458    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645460    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645463    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645465    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645468    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645472    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645474    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645483    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645486    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645488    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645491    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645493    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645496    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 16:36:19.739242 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645498    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645501    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645504    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645507    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645509    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645513    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645516    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645519    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645521    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645524    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645526    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645529    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645531    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.645535    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645607    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645616    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645625    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645632    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645650    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645654    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645658    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 16:36:19.740202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645662    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645665    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645668    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645673    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645677    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645680    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645684    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645687    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645690    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645692    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645695    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645699    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645702    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645705    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645708    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645712    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645715    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645718    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645721    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645725    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645727    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645730    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645733    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645736    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 16:36:19.741386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645740    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645745    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645748    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645751    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645753    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645757    2574 flags.go:64] FLAG: --enable-server="true"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645760    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645765    2574 flags.go:64] FLAG: --event-burst="100"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645768    2574 flags.go:64] FLAG: --event-qps="50"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645771    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645774    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645778    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645781    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645785    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645787    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645791    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645794    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645797    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645800    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645803    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645806    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645809    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645812    2574 flags.go:64] FLAG: --feature-gates=""
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645815    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645818    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 16:36:19.742450 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645821    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645824    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645827    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645830    2574 flags.go:64] FLAG: --help="false"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645833    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-137-50.ec2.internal"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645836    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645839    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645843    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645846    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645849    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645852    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645855    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645857    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645860    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645863    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645866    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645869    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645872    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645875    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645878    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645882    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645885    2574 flags.go:64] FLAG: --lock-file=""
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645887    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645891    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 16:36:19.743515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645894    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645900    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645902    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645905    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645908    2574 flags.go:64] FLAG: --logging-format="text"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645911    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645914    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645917    2574 flags.go:64] FLAG: --manifest-url=""
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645920    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645924    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645939    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645943    2574 flags.go:64] FLAG: --max-pods="110"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645946    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645949    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645952    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645956    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645959    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645962    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645965    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645972    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645975    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645978    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645981    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 10 16:36:19.745746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645984    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645989    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645991    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645994    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.645999    2574 flags.go:64] FLAG: --port="10250"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646002    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646005    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-054b109a9d5bfdc93"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646008    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646011    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646014    2574 flags.go:64] FLAG: --register-node="true"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646017    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646021    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646024    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646026    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646029    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646033    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646036    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646039    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646041    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646044    2574 flags.go:64] FLAG: --runonce="false"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646047    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646050    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646053    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646056    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646060    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646063    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 16:36:19.746428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646066    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646069    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646072    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646074    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646077    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646080    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646083    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646086    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646088    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646094    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646098    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646100    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646104    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646107    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646110    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646113    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646116    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646119    2574 flags.go:64] FLAG: --v="2"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646123    2574 flags.go:64] FLAG: --version="false"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646127    2574 flags.go:64] FLAG: --vmodule=""
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646130    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646134    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646260    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646264    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 16:36:19.969063 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646267    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646270    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646273    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646275    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646278    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646280    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646284    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646286    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646289    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646291    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646294    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646297    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646299    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646301    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646304    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646307    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646309    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646312    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646316    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646318    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 16:36:19.990913 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646321    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646324    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646326    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646328    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646331    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646334    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646337    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646339    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646342    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646346    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646349    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646352    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646356    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646359    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646361    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646364    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646367    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646369    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646373    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 16:36:19.992216 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646376    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646378    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646381    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646383    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646386    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646388    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646391    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646393    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646396    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646398    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646401    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646405    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646408    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646412    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646415    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646417    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646420    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646423    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646426    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 16:36:19.993282 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646429    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646431    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646434    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646436    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646439    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646442    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646445    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646447    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646450    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646454    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646457    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646459    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646464    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646467    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646470    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646473    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646475    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646478    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646480    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 16:36:19.994160 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646483    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646485    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646488    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646490    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646493    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646496    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646499    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646502    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646504    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646507    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646510    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646512    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646515    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646518    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646521    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646523    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646526    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646528    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646531    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 16:36:19.995272 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.646533    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.646538    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.653169    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.653183    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.653196    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.653205    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653261    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653266    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653270    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653273    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653276    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653279    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653281    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653284    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653287    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 16:36:19.996131 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653289    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653292    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653296    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653300    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653303    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653305    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653308    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653311    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653314    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653317    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653319    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653322    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653325    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653328    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653331    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653334    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653336    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653339    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653342    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 16:36:19.997232 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653345    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653347    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653350    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653352    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653355    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653357    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653360    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653363    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653366    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653368    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653371    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653373    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653376    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653378    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653381    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653383    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653386    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653388    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653390    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653393    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 16:36:19.998134 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653395    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653398    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653400    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653404    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653408    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653411    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653414    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653420    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653423    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653426    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653429    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653432    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653434    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653437    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653439    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653442    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653445    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653447    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653450    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 16:36:19.999012 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653454    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653457    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653460    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653463    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653466    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653468    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653471    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653474    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653477    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653479    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653482    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653484    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653487    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653490    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653492    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653495    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653498    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653500    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653503    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 16:36:19.999884 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653506    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653510    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653517    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653520    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653523    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653525    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653528    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653530    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653533    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653535    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653538    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653540    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653544    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.653548    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653653    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 16:36:20.000780 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653658    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653661    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653663    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653666    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653669    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653672    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653675    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653677    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653680    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653682    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653688    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653691    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653694    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653696    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653699    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653701    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653704    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653706    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653709    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653714    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 16:36:20.001437 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653717    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653720    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653722    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653726    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653729    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653733    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653736    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653739    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653741    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653744    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653747    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653751    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653754    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653757    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653760    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653763    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653766    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653768    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653770    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 16:36:20.002331 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653773    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653776    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653778    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653781    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653783    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653786    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653788    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653791    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653793    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653796    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653798    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653801    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653806    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653809    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653812    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653814    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653817    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653819    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653822    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653824    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 16:36:20.003204 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653827    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653829    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653832    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653834    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653837    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653839    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653842    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653844    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653847    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653849    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653852    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653854    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653857    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653859    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653862    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653864    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653867    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653870    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653872    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653874    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 16:36:20.004435 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653877    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653879    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653882    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653884    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653889    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653892    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653895    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653898    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653902    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653905    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653908    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653910    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653913    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653915    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653918    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653920    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653923    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653940    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 16:36:20.005357 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:19.653943    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.653948    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.654040    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.656113    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.657320    2574 server.go:1019] "Starting client certificate rotation"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.657429    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.657467    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.659493    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.665943    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.675479    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.682597    2574 log.go:25] "Validated CRI v1 image API"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.683352    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 16:36:20.006240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.685412    2574 fs.go:135] Filesystem UUIDs: map[4039690f-12d3-4e4d-95ca-8e2f34ca574b:/dev/nvme0n1p3 6aa75cb1-6fc2-4ef0-a134-20a4fbae4715:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 10 16:36:20.006881 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.685433    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 16:36:20.006881 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.689474    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.691104    2574 manager.go:216] Machine: {Timestamp:2026-07-10 16:36:19.689815648 +0000 UTC m=+0.289991294 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099727 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ec69d9e4b3fa9f7bf92514c237009 SystemUUID:ec2ec69d-9e4b-3fa9-f7bf-92514c237009 BootID:37446686-1a6e-4ed9-a3ff-41aa795fc8a7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:4e:96:dd:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:4e:96:dd:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:81:e4:91:37:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.691244    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.691329    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.693856    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.693879    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-50.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.694610    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.694620    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.694627    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.695238    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.696029    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.699897    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.700040    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.700078    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.700098    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.700116    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.700129    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.700141    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 16:36:20.009413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.700533    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.700548    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.705188    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.706512    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.706540    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707198    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707214    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707220    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707225    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707234    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707239    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707248    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707253    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707259    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707265    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707281    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707287    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707910    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.707916    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.711593    2574 server.go:1268] "Started kubelet"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.711684    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.711766    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.711799    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.712950    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.714211    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.716944    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.717016    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.717174    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.721827    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.722575    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723193    2574 factory.go:55] Registering systemd factory
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723241    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723376    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723391    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723527    2574 factory.go:153] Registering CRI-O factory
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723543    2574 factory.go:223] Registration of the crio container factory successfully
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723580    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723588    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723593    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723618    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-50.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723625    2574 factory.go:103] Registering Raw factory
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.723826    2574 manager.go:1196] Started watching for new ooms in manager
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.724183    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.724204    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.724198    2574 manager.go:349] Starting recovery of all containers
Jul 10 16:36:20.010268 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.730022    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.730046    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.723722    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-50.ec2.internal.18c0faf45314fb95  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-50.ec2.internal,UID:ip-10-0-137-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-50.ec2.internal,},FirstTimestamp:2026-07-10 16:36:19.711564693 +0000 UTC m=+0.311740342,LastTimestamp:2026-07-10 16:36:19.711564693 +0000 UTC m=+0.311740342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-50.ec2.internal,}"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.738983    2574 manager.go:354] Recovery completed
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.745599    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-29x9t"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.745850    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.747814    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.747848    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.747862    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientPID"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.747876    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-29x9t"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.748473    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.748486    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.748485    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.748555    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.749227    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.749251    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.749262    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientPID"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.749980    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-50.ec2.internal.18c0faf4553e5ad1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-50.ec2.internal,UID:ip-10-0-137-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-50.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-50.ec2.internal,},FirstTimestamp:2026-07-10 16:36:19.747830481 +0000 UTC m=+0.348006127,LastTimestamp:2026-07-10 16:36:19.747830481 +0000 UTC m=+0.348006127,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-50.ec2.internal,}"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.750893    2574 policy_none.go:49] "None policy: Start"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.750905    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.750915    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.752898    2574 policy_none.go:47] "Start"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.798516    2574 manager.go:337] "Starting Device Plugin manager"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.798693    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.798706    2574 server.go:87] "Starting device plugin registration server"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.798906    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.798915    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.799022    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.799101    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.799111    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.800115    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.800156    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.859478    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.860609    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.860640    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 16:36:20.215492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.860674    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.860708    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.863119    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.900144    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.901083    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.901109    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.901125    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientPID"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.901169    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.910581    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.910600    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-50.ec2.internal\": node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:19.937696    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.961581    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"]
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.961661    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.962620    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.962647    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.962659    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientPID"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.965474    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.965570    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.965600    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.968904    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.968919    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.968942    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.968956    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.968967    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientPID"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.968958    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientPID"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.971210    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.971233    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.971882    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.971907    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:19.971917    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeHasSufficientPID"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.021699    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-50.ec2.internal\" not found" node="ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.024600    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b19ef9cad8aadaa6a93113a3d0bf1d5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-50.ec2.internal\" (UID: \"5b19ef9cad8aadaa6a93113a3d0bf1d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.024640    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ad841246f60399d03ce8ddcc1ce785c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal\" (UID: \"4ad841246f60399d03ce8ddcc1ce785c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.024659    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ad841246f60399d03ce8ddcc1ce785c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal\" (UID: \"4ad841246f60399d03ce8ddcc1ce785c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.217293 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.026244    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-50.ec2.internal\" not found" node="ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.218294 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.038469    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.218294 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.125121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b19ef9cad8aadaa6a93113a3d0bf1d5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-50.ec2.internal\" (UID: \"5b19ef9cad8aadaa6a93113a3d0bf1d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.218294 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.125152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ad841246f60399d03ce8ddcc1ce785c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal\" (UID: \"4ad841246f60399d03ce8ddcc1ce785c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.218294 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.125170    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ad841246f60399d03ce8ddcc1ce785c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal\" (UID: \"4ad841246f60399d03ce8ddcc1ce785c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.218294 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.125230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4ad841246f60399d03ce8ddcc1ce785c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal\" (UID: \"4ad841246f60399d03ce8ddcc1ce785c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.218294 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.125237    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b19ef9cad8aadaa6a93113a3d0bf1d5-config\") pod \"kube-apiserver-proxy-ip-10-0-137-50.ec2.internal\" (UID: \"5b19ef9cad8aadaa6a93113a3d0bf1d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.218294 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.125281    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ad841246f60399d03ce8ddcc1ce785c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal\" (UID: \"4ad841246f60399d03ce8ddcc1ce785c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.218294 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.139244    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.414321 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.240232    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.414321 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.328199    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.414321 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.329333    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:20.414321 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.341101    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.637793 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.441973    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.637793 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.543136    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.637793 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.627253    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 16:36:20.645092 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.644825    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.848798 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.656829    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 16:36:20.848798 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.657006    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 16:36:20.848798 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.657037    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 16:36:20.848798 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.745371    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:20.848798 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.752504    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 16:31:20 +0000 UTC" deadline="2028-04-04 14:48:31.50315468 +0000 UTC"
Jul 10 16:36:20.848798 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:20.752527    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15214h12m10.750630667s"
Jul 10 16:36:20.848798 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.846267    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:21.023273 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:20.946821    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:21.203865 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.047129    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:21.203865 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:21.098132    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad841246f60399d03ce8ddcc1ce785c.slice/crio-d706ffbc74aa03351f21b37832176031a3d1a379c2ffe47bacb41a1ee71238ff WatchSource:0}: Error finding container d706ffbc74aa03351f21b37832176031a3d1a379c2ffe47bacb41a1ee71238ff: Status 404 returned error can't find the container with id d706ffbc74aa03351f21b37832176031a3d1a379c2ffe47bacb41a1ee71238ff
Jul 10 16:36:21.203865 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:21.098815    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b19ef9cad8aadaa6a93113a3d0bf1d5.slice/crio-e21f47df721e0982fcb19eaf497827856341efb1dd91c4175d3e341cf06fa45d WatchSource:0}: Error finding container e21f47df721e0982fcb19eaf497827856341efb1dd91c4175d3e341cf06fa45d: Status 404 returned error can't find the container with id e21f47df721e0982fcb19eaf497827856341efb1dd91c4175d3e341cf06fa45d
Jul 10 16:36:21.203865 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.103938    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 16:36:21.203865 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.124251    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 16:36:21.203865 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.148436    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-50.ec2.internal\" not found"
Jul 10 16:36:21.207302 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.207099    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 16:36:21.415288 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.222902    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:21.415288 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.233985    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 16:36:21.415288 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.234952    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal"
Jul 10 16:36:21.415288 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.258603    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.645018    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.702559    2574 apiserver.go:52] "Watching apiserver"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.709952    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.711643    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-tvkht","openshift-multus/multus-wlr8h","openshift-network-diagnostics/network-check-target-vcldr","kube-system/konnectivity-agent-mbx4l","openshift-cluster-node-tuning-operator/tuned-hp4m4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal","openshift-multus/network-metrics-daemon-qlswx","openshift-network-operator/iptables-alerter-zrblm","openshift-ovn-kubernetes/ovnkube-node-bn486","kube-system/global-pull-secret-syncer-sl5ck","kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz","openshift-dns/node-resolver-7f427","openshift-image-registry/node-ca-rbzv8"]
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.715633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.715708    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.717881    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.720187    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.720269    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.720851    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.721231    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.721681    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.722903    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.723057    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9d224\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.724418    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.726734    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.727600    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.727608    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.727690    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g2jls\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.728978    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.729348    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sclwt\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.729751    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.729884    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.731861    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bx8rx\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.732095    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.732981    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.733263    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.733445    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.735271    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.736238    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.736568    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 16:36:21.766050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.736611    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.736771    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.736800    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.736937    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737078    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2xp4r\""
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737133    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737387    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-registration-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737418    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5z5c\" (UniqueName: \"kubernetes.io/projected/6df769b8-14bb-4309-b135-f356e95f75e1-kube-api-access-c5z5c\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737548    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3-agent-certs\") pod \"konnectivity-agent-mbx4l\" (UID: \"3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3\") " pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737574    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-device-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737600    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-sys-fs\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737627    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3-konnectivity-ca\") pod \"konnectivity-agent-mbx4l\" (UID: \"3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3\") " pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-socket-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4hgb\" (UniqueName: \"kubernetes.io/projected/ccbeb788-f3e1-4436-9520-58ee40393d6a-kube-api-access-z4hgb\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.737904    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.738445    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s7zq2\""
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.738651    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 16:36:21.767791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.740509    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.744468    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.744546    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.745578    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.748937    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.748958    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.748953    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-flhsz\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.749205    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.749441    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.749525    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6ggs4\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.749562    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.749598    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.749740    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.750057    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.750262    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.750311    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.750321    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c45jp\""
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.758122    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gqqb"
Jul 10 16:36:21.769406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.768218    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gqqb"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.824240    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.838880    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-cni-multus\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.838919    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-ovn\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.838954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-hosts-file\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-kubelet\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839032    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-host\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839056    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-sys-fs\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-cnibin\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839129    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-sys-fs\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839132    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-daemon-config\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839156    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-slash\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839178    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-systemd\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839193    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-cnibin\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-socket-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839225    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-kubelet\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.927305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-tmp-dir\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-systemd\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839387    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-socket-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839427    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839463    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5z5c\" (UniqueName: \"kubernetes.io/projected/6df769b8-14bb-4309-b135-f356e95f75e1-kube-api-access-c5z5c\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839509    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovnkube-config\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839555    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-env-overrides\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839592    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839692    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjg84\" (UniqueName: \"kubernetes.io/projected/88d91a45-22a3-45f0-b800-125650e7d68b-kube-api-access-qjg84\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-var-lib-kubelet\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6ft2\" (UniqueName: \"kubernetes.io/projected/0f05421e-33ce-47da-907f-558c5b2dedbc-kube-api-access-j6ft2\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839781    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-systemd-units\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839810    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysctl-d\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.931607 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-sys\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-system-cni-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.839982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22f59fc7-5213-4c46-bb56-375112bb3e54-serviceca\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840006    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-run-netns\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840031    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840057    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840096    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-cni-binary-copy\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.840155    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840191    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-cni-netd\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.840240    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:22.340208734 +0000 UTC m=+2.940384372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840273    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9txxg\" (UniqueName: \"kubernetes.io/projected/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-kube-api-access-9txxg\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3-agent-certs\") pod \"konnectivity-agent-mbx4l\" (UID: \"3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3\") " pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840315    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-device-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-modprobe-d\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.932777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840366    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysconfig\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840367    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-device-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-etc-kubernetes\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-var-lib-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840441    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovn-node-metrics-cert\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840459    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-host-slash\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66rbs\" (UniqueName: \"kubernetes.io/projected/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-kube-api-access-66rbs\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4hgb\" (UniqueName: \"kubernetes.io/projected/ccbeb788-f3e1-4436-9520-58ee40393d6a-kube-api-access-z4hgb\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840523    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-cni-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-os-release\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-cni-bin\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-cni-bin\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-registration-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840678    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysctl-conf\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840677    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-tuned\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840717    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f05421e-33ce-47da-907f-558c5b2dedbc-tmp\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.935540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840742    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-conf-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-registration-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-multus-certs\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840790    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-etc-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840827    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-hostroot\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840869    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f199d4f9-fbed-411d-ac9a-9fabecf00c50-dbus\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840900    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-iptables-alerter-script\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840931    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840949    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccbeb788-f3e1-4436-9520-58ee40393d6a-etc-selinux\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.840978    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-log-socket\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841002    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovnkube-script-lib\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-kubernetes\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841038    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-lib-modules\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.936501 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841068    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-k8s-cni-cncf-io\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841095    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn6m9\" (UniqueName: \"kubernetes.io/projected/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-kube-api-access-cn6m9\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841118    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3-konnectivity-ca\") pod \"konnectivity-agent-mbx4l\" (UID: \"3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3\") " pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841147    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-run\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-netns\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f199d4f9-fbed-411d-ac9a-9fabecf00c50-kubelet-config\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.841752    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2hb\" (UniqueName: \"kubernetes.io/projected/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-kube-api-access-fx2hb\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.842431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-socket-dir-parent\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.842472    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3-konnectivity-ca\") pod \"konnectivity-agent-mbx4l\" (UID: \"3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3\") " pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.842668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22f59fc7-5213-4c46-bb56-375112bb3e54-host\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.843115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf82p\" (UniqueName: \"kubernetes.io/projected/22f59fc7-5213-4c46-bb56-375112bb3e54-kube-api-access-kf82p\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.843431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-node-log\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.843569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-os-release\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.844409    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3-agent-certs\") pod \"konnectivity-agent-mbx4l\" (UID: \"3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3\") " pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.847397    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.847421    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.847435    2574 projected.go:196] Error preparing data for projected volume kube-api-access-tvbxs for pod openshift-network-diagnostics/network-check-target-vcldr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:21.938812 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.847532    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs podName:b6e6239e-bdd2-4137-846a-d32c6d773030 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:22.347513361 +0000 UTC m=+2.947688998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tvbxs" (UniqueName: "kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs") pod "network-check-target-vcldr" (UID: "b6e6239e-bdd2-4137-846a-d32c6d773030") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:21.939774 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.850194    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5z5c\" (UniqueName: \"kubernetes.io/projected/6df769b8-14bb-4309-b135-f356e95f75e1-kube-api-access-c5z5c\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:21.939774 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.850442    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4hgb\" (UniqueName: \"kubernetes.io/projected/ccbeb788-f3e1-4436-9520-58ee40393d6a-kube-api-access-z4hgb\") pod \"aws-ebs-csi-driver-node-hmsdz\" (UID: \"ccbeb788-f3e1-4436-9520-58ee40393d6a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:21.939774 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.866095    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal" event={"ID":"4ad841246f60399d03ce8ddcc1ce785c","Type":"ContainerStarted","Data":"d706ffbc74aa03351f21b37832176031a3d1a379c2ffe47bacb41a1ee71238ff"}
Jul 10 16:36:21.939774 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.867447    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal" event={"ID":"5b19ef9cad8aadaa6a93113a3d0bf1d5","Type":"ContainerStarted","Data":"e21f47df721e0982fcb19eaf497827856341efb1dd91c4175d3e341cf06fa45d"}
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944515    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-hosts-file\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944565    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-kubelet\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944592    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-host\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944682    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-kubelet\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944694    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-hosts-file\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-cnibin\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944767    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-host\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-daemon-config\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944823    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-slash\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-cnibin\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-systemd\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-cnibin\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-kubelet\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.944888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944884    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-slash\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-cnibin\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944943    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-systemd\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-tmp-dir\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.944965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-kubelet\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945012    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-systemd\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945085    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945111    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovnkube-config\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945144    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-systemd\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945188    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-run-ovn-kubernetes\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945217    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-env-overrides\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945247    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-tmp-dir\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945369    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:21.945778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-daemon-config\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945417    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjg84\" (UniqueName: \"kubernetes.io/projected/88d91a45-22a3-45f0-b800-125650e7d68b-kube-api-access-qjg84\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945421    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-system-cni-dir\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-var-lib-kubelet\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945478    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6ft2\" (UniqueName: \"kubernetes.io/projected/0f05421e-33ce-47da-907f-558c5b2dedbc-kube-api-access-j6ft2\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-systemd-units\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945546    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysctl-d\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-sys\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945601    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-system-cni-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945659    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22f59fc7-5213-4c46-bb56-375112bb3e54-serviceca\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-run-netns\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945740    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-cni-binary-copy\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-cni-netd\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.031594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txxg\" (UniqueName: \"kubernetes.io/projected/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-kube-api-access-9txxg\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945853    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-var-lib-kubelet\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-modprobe-d\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945873    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945894    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysconfig\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945918    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-etc-kubernetes\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945922    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-systemd-units\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945954    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-var-lib-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945969    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-etc-kubernetes\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946003    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946042    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-system-cni-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946113    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-cni-netd\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.945787    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-sys\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovn-node-metrics-cert\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946165    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-host-slash\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946181    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysconfig\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.946185    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946201    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66rbs\" (UniqueName: \"kubernetes.io/projected/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-kube-api-access-66rbs\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:22.032928 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-run-netns\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-cni-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:21.946248    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret podName:f199d4f9-fbed-411d-ac9a-9fabecf00c50 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:22.446229429 +0000 UTC m=+3.046405063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret") pod "global-pull-secret-syncer-sl5ck" (UID: "f199d4f9-fbed-411d-ac9a-9fabecf00c50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946279    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysctl-d\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946167    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-modprobe-d\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946343    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-os-release\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946366    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-host-slash\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946429    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-var-lib-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946280    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-os-release\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946423    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-cni-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946433    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovnkube-config\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946475    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-cni-bin\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946504    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-cni-bin\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-cni-bin\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/88d91a45-22a3-45f0-b800-125650e7d68b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946531    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysctl-conf\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946557    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-host-cni-bin\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.035908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946560    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-tuned\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946597    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f05421e-33ce-47da-907f-558c5b2dedbc-tmp\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946692    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-sysctl-conf\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946700    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-conf-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946742    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-conf-dir\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-multus-certs\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946786    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-multus-certs\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-etc-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946818    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-etc-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946833    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-hostroot\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946857    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f199d4f9-fbed-411d-ac9a-9fabecf00c50-dbus\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946879    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-hostroot\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946883    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-cni-binary-copy\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.946899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-iptables-alerter-script\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947023    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/22f59fc7-5213-4c46-bb56-375112bb3e54-serviceca\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947029    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f199d4f9-fbed-411d-ac9a-9fabecf00c50-dbus\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-log-socket\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.037312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947129    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovnkube-script-lib\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947147    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-env-overrides\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947158    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-kubernetes\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-openvswitch\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947183    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-lib-modules\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-k8s-cni-cncf-io\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947236    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn6m9\" (UniqueName: \"kubernetes.io/projected/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-kube-api-access-cn6m9\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947262    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-run\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947263    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-kubernetes\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-netns\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947312    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f199d4f9-fbed-411d-ac9a-9fabecf00c50-kubelet-config\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2hb\" (UniqueName: \"kubernetes.io/projected/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-kube-api-access-fx2hb\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947363    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-lib-modules\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947367    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-socket-dir-parent\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22f59fc7-5213-4c46-bb56-375112bb3e54-host\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947430    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf82p\" (UniqueName: \"kubernetes.io/projected/22f59fc7-5213-4c46-bb56-375112bb3e54-kube-api-access-kf82p\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-multus-socket-dir-parent\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-log-socket\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.041047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947491    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-iptables-alerter-script\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947501    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22f59fc7-5213-4c46-bb56-375112bb3e54-host\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f199d4f9-fbed-411d-ac9a-9fabecf00c50-kubelet-config\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947605    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f05421e-33ce-47da-907f-558c5b2dedbc-run\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947637    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovnkube-script-lib\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947647    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-netns\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947675    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-node-log\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-run-k8s-cni-cncf-io\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-os-release\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947741    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-cni-multus\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-node-log\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947767    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-ovn\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947819    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/88d91a45-22a3-45f0-b800-125650e7d68b-os-release\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947842    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-host-var-lib-cni-multus\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.947845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-run-ovn\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.949068    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-ovn-node-metrics-cert\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.949629    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f05421e-33ce-47da-907f-558c5b2dedbc-etc-tuned\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.949649    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f05421e-33ce-47da-907f-558c5b2dedbc-tmp\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.042398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.959303    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6ft2\" (UniqueName: \"kubernetes.io/projected/0f05421e-33ce-47da-907f-558c5b2dedbc-kube-api-access-j6ft2\") pod \"tuned-hp4m4\" (UID: \"0f05421e-33ce-47da-907f-558c5b2dedbc\") " pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.959662    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9txxg\" (UniqueName: \"kubernetes.io/projected/2179c8ae-e467-4b7f-ab15-25c286eb1d3b-kube-api-access-9txxg\") pod \"ovnkube-node-bn486\" (UID: \"2179c8ae-e467-4b7f-ab15-25c286eb1d3b\") " pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.963227    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf82p\" (UniqueName: \"kubernetes.io/projected/22f59fc7-5213-4c46-bb56-375112bb3e54-kube-api-access-kf82p\") pod \"node-ca-rbzv8\" (UID: \"22f59fc7-5213-4c46-bb56-375112bb3e54\") " pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.963282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66rbs\" (UniqueName: \"kubernetes.io/projected/fefb9913-a6f3-477a-af16-8fd08cd8d2b3-kube-api-access-66rbs\") pod \"iptables-alerter-zrblm\" (UID: \"fefb9913-a6f3-477a-af16-8fd08cd8d2b3\") " pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.963276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn6m9\" (UniqueName: \"kubernetes.io/projected/d2573b8a-2be3-4ba0-9b55-6848ae4f91f8-kube-api-access-cn6m9\") pod \"multus-wlr8h\" (UID: \"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8\") " pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.967483    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2hb\" (UniqueName: \"kubernetes.io/projected/76c5f1d2-ca9e-44a3-9a36-aba1253886ee-kube-api-access-fx2hb\") pod \"node-resolver-7f427\" (UID: \"76c5f1d2-ca9e-44a3-9a36-aba1253886ee\") " pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:21.967482    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjg84\" (UniqueName: \"kubernetes.io/projected/88d91a45-22a3-45f0-b800-125650e7d68b-kube-api-access-qjg84\") pod \"multus-additional-cni-plugins-tvkht\" (UID: \"88d91a45-22a3-45f0-b800-125650e7d68b\") " pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.031478    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.041054    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:22.042624    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbeb788_f3e1_4436_9520_58ee40393d6a.slice/crio-24777f44c1058118a97c4e9892ac9d838e38192e2fd222164cb5e390ba11b834 WatchSource:0}: Error finding container 24777f44c1058118a97c4e9892ac9d838e38192e2fd222164cb5e390ba11b834: Status 404 returned error can't find the container with id 24777f44c1058118a97c4e9892ac9d838e38192e2fd222164cb5e390ba11b834
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.047923    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hp4m4"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:22.054000    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c40fe4a_2ee8_4a4f_8524_9fe0aa111da3.slice/crio-54680dd648a10218acacc90e0a3540854286c95f284df7235c90c5fd761e1cfa WatchSource:0}: Error finding container 54680dd648a10218acacc90e0a3540854286c95f284df7235c90c5fd761e1cfa: Status 404 returned error can't find the container with id 54680dd648a10218acacc90e0a3540854286c95f284df7235c90c5fd761e1cfa
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.054336    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rbzv8"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.062415    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:22.062896    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f05421e_33ce_47da_907f_558c5b2dedbc.slice/crio-f239a9e8bc6bd68a8d72a976c6214a26e7dc020ebba468389186d0e2d92c6894 WatchSource:0}: Error finding container f239a9e8bc6bd68a8d72a976c6214a26e7dc020ebba468389186d0e2d92c6894: Status 404 returned error can't find the container with id f239a9e8bc6bd68a8d72a976c6214a26e7dc020ebba468389186d0e2d92c6894
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.070471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tvkht"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:22.071011    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f59fc7_5213_4c46_bb56_375112bb3e54.slice/crio-c1a34ce243abea320fde910d9b477189f739d26baec27606d4241b18ac02d243 WatchSource:0}: Error finding container c1a34ce243abea320fde910d9b477189f739d26baec27606d4241b18ac02d243: Status 404 returned error can't find the container with id c1a34ce243abea320fde910d9b477189f739d26baec27606d4241b18ac02d243
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:22.077764    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2179c8ae_e467_4b7f_ab15_25c286eb1d3b.slice/crio-e545d05145afceb5da94b041bfd5b4d64b8e0b34b1abfd0b022b27c6cdcda197 WatchSource:0}: Error finding container e545d05145afceb5da94b041bfd5b4d64b8e0b34b1abfd0b022b27c6cdcda197: Status 404 returned error can't find the container with id e545d05145afceb5da94b041bfd5b4d64b8e0b34b1abfd0b022b27c6cdcda197
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.078792    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wlr8h"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.086772    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7f427"
Jul 10 16:36:22.109055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.096162    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zrblm"
Jul 10 16:36:22.161621 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:22.161591    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefb9913_a6f3_477a_af16_8fd08cd8d2b3.slice/crio-13bc39584d8fe30a54da87c567ca5e34922df4c81e76162230e1bf030aec6ee6 WatchSource:0}: Error finding container 13bc39584d8fe30a54da87c567ca5e34922df4c81e76162230e1bf030aec6ee6: Status 404 returned error can't find the container with id 13bc39584d8fe30a54da87c567ca5e34922df4c81e76162230e1bf030aec6ee6
Jul 10 16:36:22.357148 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.357036    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:22.357311 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.357165    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:22.357391 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.357378    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:22.358079 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.357448    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:23.357427988 +0000 UTC m=+3.957603627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:22.358079 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.357976    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 16:36:22.358333 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.358306    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 16:36:22.358449 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.358342    2574 projected.go:196] Error preparing data for projected volume kube-api-access-tvbxs for pod openshift-network-diagnostics/network-check-target-vcldr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:22.358449 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.358435    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs podName:b6e6239e-bdd2-4137-846a-d32c6d773030 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:23.358415596 +0000 UTC m=+3.958591234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvbxs" (UniqueName: "kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs") pod "network-check-target-vcldr" (UID: "b6e6239e-bdd2-4137-846a-d32c6d773030") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:22.457731 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.457589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:22.457891 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.457748    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:22.457891 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.457820    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret podName:f199d4f9-fbed-411d-ac9a-9fabecf00c50 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:23.457797658 +0000 UTC m=+4.057973308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret") pod "global-pull-secret-syncer-sl5ck" (UID: "f199d4f9-fbed-411d-ac9a-9fabecf00c50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:22.771895 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.771832    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 16:31:22 +0000 UTC" deadline="2027-12-18 01:42:41.062899495 +0000 UTC"
Jul 10 16:36:22.771895 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.771889    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12609h6m18.291014503s"
Jul 10 16:36:22.860950 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.860900    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:22.861133 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:22.861059    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:22.870757 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.870723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zrblm" event={"ID":"fefb9913-a6f3-477a-af16-8fd08cd8d2b3","Type":"ContainerStarted","Data":"13bc39584d8fe30a54da87c567ca5e34922df4c81e76162230e1bf030aec6ee6"}
Jul 10 16:36:22.872226 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.872186    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"e545d05145afceb5da94b041bfd5b4d64b8e0b34b1abfd0b022b27c6cdcda197"}
Jul 10 16:36:22.873539 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.873505    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hp4m4" event={"ID":"0f05421e-33ce-47da-907f-558c5b2dedbc","Type":"ContainerStarted","Data":"f239a9e8bc6bd68a8d72a976c6214a26e7dc020ebba468389186d0e2d92c6894"}
Jul 10 16:36:22.875059 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.875030    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7f427" event={"ID":"76c5f1d2-ca9e-44a3-9a36-aba1253886ee","Type":"ContainerStarted","Data":"f525cf3786b8b72aeb7ec204c0d478ee369cb884f592594992f318eb322a8a82"}
Jul 10 16:36:22.876273 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.876248    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkht" event={"ID":"88d91a45-22a3-45f0-b800-125650e7d68b","Type":"ContainerStarted","Data":"87dcf206ea9681903c5bb58a67ae8485cc5378c4186184225c14a426930307e4"}
Jul 10 16:36:22.877586 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.877561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wlr8h" event={"ID":"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8","Type":"ContainerStarted","Data":"d16f02cd2e587ac44d6cd77c2ddfb4727bbc5d2bc7e91b34254e10dd8db3a5aa"}
Jul 10 16:36:22.878733 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.878707    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rbzv8" event={"ID":"22f59fc7-5213-4c46-bb56-375112bb3e54","Type":"ContainerStarted","Data":"c1a34ce243abea320fde910d9b477189f739d26baec27606d4241b18ac02d243"}
Jul 10 16:36:22.879888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.879864    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mbx4l" event={"ID":"3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3","Type":"ContainerStarted","Data":"54680dd648a10218acacc90e0a3540854286c95f284df7235c90c5fd761e1cfa"}
Jul 10 16:36:22.881095 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:22.881072    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz" event={"ID":"ccbeb788-f3e1-4436-9520-58ee40393d6a","Type":"ContainerStarted","Data":"24777f44c1058118a97c4e9892ac9d838e38192e2fd222164cb5e390ba11b834"}
Jul 10 16:36:23.364241 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.364203    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:23.364974 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.364263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:23.364974 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.364392    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:23.364974 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.364411    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 16:36:23.364974 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.364441    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 16:36:23.364974 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.364457    2574 projected.go:196] Error preparing data for projected volume kube-api-access-tvbxs for pod openshift-network-diagnostics/network-check-target-vcldr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:23.364974 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.364466    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:25.364445119 +0000 UTC m=+5.964620759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:23.364974 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.364510    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs podName:b6e6239e-bdd2-4137-846a-d32c6d773030 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:25.364492707 +0000 UTC m=+5.964668359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvbxs" (UniqueName: "kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs") pod "network-check-target-vcldr" (UID: "b6e6239e-bdd2-4137-846a-d32c6d773030") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:23.464619 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.464583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:23.464811 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.464734    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:23.464884 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.464823    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret podName:f199d4f9-fbed-411d-ac9a-9fabecf00c50 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:25.464800785 +0000 UTC m=+6.064976426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret") pod "global-pull-secret-syncer-sl5ck" (UID: "f199d4f9-fbed-411d-ac9a-9fabecf00c50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:23.661622 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.661437    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 16:36:23.772898 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.772818    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 16:31:22 +0000 UTC" deadline="2028-01-17 15:57:49.689007229 +0000 UTC"
Jul 10 16:36:23.772898 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.772859    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13343h21m25.91615291s"
Jul 10 16:36:23.864408 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.863681    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:23.864408 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.863820    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:23.864408 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.864252    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:23.864408 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:23.864350    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:23.894118 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:23.892819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal" event={"ID":"5b19ef9cad8aadaa6a93113a3d0bf1d5","Type":"ContainerStarted","Data":"8299d7d7762bf4638029f99f647e40d05c3785ba7eac325b556dafd89b98dee2"}
Jul 10 16:36:24.861858 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:24.861802    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:24.862373 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:24.861974    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:24.902165 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:24.902075    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal" event={"ID":"4ad841246f60399d03ce8ddcc1ce785c","Type":"ContainerStarted","Data":"125b4fca3fabe3ef8c5c59f6d09fa4d51ae527a35a5338aeb7dedf210c278d6c"}
Jul 10 16:36:24.920651 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:24.920589    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-50.ec2.internal" podStartSLOduration=3.920568593 podStartE2EDuration="3.920568593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:23.911767831 +0000 UTC m=+4.511943489" watchObservedRunningTime="2026-07-10 16:36:24.920568593 +0000 UTC m=+5.520744252"
Jul 10 16:36:25.379512 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:25.378613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:25.379512 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:25.378687    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:25.379512 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.378850    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:25.379512 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.378916    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:29.378896569 +0000 UTC m=+9.979072210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:25.379512 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.379375    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 16:36:25.379512 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.379396    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 16:36:25.379512 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.379409    2574 projected.go:196] Error preparing data for projected volume kube-api-access-tvbxs for pod openshift-network-diagnostics/network-check-target-vcldr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:25.379512 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.379461    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs podName:b6e6239e-bdd2-4137-846a-d32c6d773030 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:29.379442894 +0000 UTC m=+9.979618547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvbxs" (UniqueName: "kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs") pod "network-check-target-vcldr" (UID: "b6e6239e-bdd2-4137-846a-d32c6d773030") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:25.480446 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:25.479603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:25.480446 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.479787    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:25.480446 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.479860    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret podName:f199d4f9-fbed-411d-ac9a-9fabecf00c50 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:29.479840701 +0000 UTC m=+10.080016351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret") pod "global-pull-secret-syncer-sl5ck" (UID: "f199d4f9-fbed-411d-ac9a-9fabecf00c50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:25.862983 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:25.862947    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:25.863505 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:25.862946    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:25.863505 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.863109    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:25.863505 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:25.863148    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:25.914398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:25.914345    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ad841246f60399d03ce8ddcc1ce785c" containerID="125b4fca3fabe3ef8c5c59f6d09fa4d51ae527a35a5338aeb7dedf210c278d6c" exitCode=0
Jul 10 16:36:25.914587 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:25.914408    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal" event={"ID":"4ad841246f60399d03ce8ddcc1ce785c","Type":"ContainerDied","Data":"125b4fca3fabe3ef8c5c59f6d09fa4d51ae527a35a5338aeb7dedf210c278d6c"}
Jul 10 16:36:26.860878 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:26.860843    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:26.861067 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:26.860986    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:27.861284 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:27.861242    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:27.861794 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:27.861394    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:27.861878 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:27.861861    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:27.862012 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:27.861986    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:28.861989 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:28.861930    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:28.862508 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:28.862125    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:29.413842 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:29.413775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:29.413842 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:29.413841    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:29.414134 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.413981    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:29.414134 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.414038    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 16:36:29.414134 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.414064    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 16:36:29.414134 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.414079    2574 projected.go:196] Error preparing data for projected volume kube-api-access-tvbxs for pod openshift-network-diagnostics/network-check-target-vcldr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:29.414134 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.414051    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:37.414031306 +0000 UTC m=+18.014206941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:29.414391 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.414145    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs podName:b6e6239e-bdd2-4137-846a-d32c6d773030 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:37.414128209 +0000 UTC m=+18.014303850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvbxs" (UniqueName: "kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs") pod "network-check-target-vcldr" (UID: "b6e6239e-bdd2-4137-846a-d32c6d773030") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:29.514912 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:29.514868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:29.515128 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.515020    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:29.515128 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.515091    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret podName:f199d4f9-fbed-411d-ac9a-9fabecf00c50 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:37.515074397 +0000 UTC m=+18.115250033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret") pod "global-pull-secret-syncer-sl5ck" (UID: "f199d4f9-fbed-411d-ac9a-9fabecf00c50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:29.862525 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:29.861942    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:29.862525 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.862087    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:29.862525 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:29.862399    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:29.863129 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:29.862524    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:30.861075 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:30.861040    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:30.861232 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:30.861203    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:31.861422 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:31.861393    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:31.861882 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:31.861519    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:31.861882 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:31.861717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:31.861882 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:31.861834    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:32.861246 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:32.861200    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:32.861432 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:32.861362    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:33.861132 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:33.861073    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:33.861277 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:33.861174    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:33.861421 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:33.861365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:33.861493 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:33.861430    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:33.937911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:33.937839    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mbx4l" event={"ID":"3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3","Type":"ContainerStarted","Data":"80b7272c8fd9600751882b864bbf4d4a84f39f7ea0d4938e92dca3b88ef2d2a5"}
Jul 10 16:36:33.939647 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:33.939617    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz" event={"ID":"ccbeb788-f3e1-4436-9520-58ee40393d6a","Type":"ContainerStarted","Data":"07bf1564ba6cc4a9ef3f8e36d25f33f7ea245095a0280a06bdc4559034e18de8"}
Jul 10 16:36:33.943773 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:33.943724    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal" event={"ID":"4ad841246f60399d03ce8ddcc1ce785c","Type":"ContainerStarted","Data":"2c674326e796872de363281ad225d5542a818eee83ca151dc3073ad1248b9a2c"}
Jul 10 16:36:33.954822 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:33.954781    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mbx4l" podStartSLOduration=2.369249947 podStartE2EDuration="13.954765299s" totalImagesPullingTime="11.585515352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:33.954179862 +0000 UTC m=+14.554355517" watchObservedRunningTime="2026-07-10 16:36:33.954765299 +0000 UTC m=+14.554940954"
Jul 10 16:36:33.959735 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:33.959705    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:33.969640 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:33.969588    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-50.ec2.internal" podStartSLOduration=12.969570653 podStartE2EDuration="12.969570653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:33.968993066 +0000 UTC m=+14.569168721" watchObservedRunningTime="2026-07-10 16:36:33.969570653 +0000 UTC m=+14.569746310"
Jul 10 16:36:34.861739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:34.861706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:34.862193 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:34.861841    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:35.861058 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:35.861020    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:35.861245 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:35.861158    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:35.861245 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:35.861215    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:35.861359 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:35.861311    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:36.497312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:36.497271    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:36.497897 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:36.497869    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:36.861863 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:36.861778    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:36.862066 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:36.861915    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:36.950356 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:36.950330    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mbx4l"
Jul 10 16:36:37.474492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:37.474460    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:37.474682 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:37.474516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:37.474682 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.474636    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:37.474682 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.474639    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 16:36:37.474682 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.474669    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 16:36:37.474862 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.474686    2574 projected.go:196] Error preparing data for projected volume kube-api-access-tvbxs for pod openshift-network-diagnostics/network-check-target-vcldr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:37.474862 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.474698    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:53.474680575 +0000 UTC m=+34.074856209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:37.474862 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.474740    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs podName:b6e6239e-bdd2-4137-846a-d32c6d773030 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:53.474723209 +0000 UTC m=+34.074898857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvbxs" (UniqueName: "kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs") pod "network-check-target-vcldr" (UID: "b6e6239e-bdd2-4137-846a-d32c6d773030") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:37.575453 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:37.575423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:37.575805 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.575543    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:37.575805 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.575589    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret podName:f199d4f9-fbed-411d-ac9a-9fabecf00c50 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:53.575577077 +0000 UTC m=+34.175752710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret") pod "global-pull-secret-syncer-sl5ck" (UID: "f199d4f9-fbed-411d-ac9a-9fabecf00c50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:37.861268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:37.861219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:37.861268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:37.861219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:37.861459 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.861373    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:37.861503 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:37.861484    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:38.861190 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:38.861153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:38.861631 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:38.861304    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:39.861910 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:39.861875    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:39.862492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:39.861959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:39.862631 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:39.862503    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:39.862631 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:39.862592    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:40.861136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:40.861095    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:40.861301 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:40.861254    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:41.861567 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:41.861538    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:41.861967 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:41.861648    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:41.861967 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:41.861734    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:41.861967 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:41.861844    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:42.581308 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.581155    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 16:36:42.814907 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.814723    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T16:36:42.581303938Z","UUID":"3ea83f85-7c1b-4013-9081-261e219f837b","Handler":null,"Name":"","Endpoint":""}
Jul 10 16:36:42.816341 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.816325    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 16:36:42.816432 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.816357    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 16:36:42.861845 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.861827    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:42.862325 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:42.861922    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:42.963118 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.963100    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:36:42.963424 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.963402    2574 generic.go:356] "Generic (PLEG): container finished" podID="2179c8ae-e467-4b7f-ab15-25c286eb1d3b" containerID="4d9eeae497213b1014565bfc0ca6df968676f15c6760abf114746927873c7c6c" exitCode=1
Jul 10 16:36:42.963495 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.963478    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"549878ca13408143746bc85255073718bd4b2f7907897ee381fe4757341dfe4e"}
Jul 10 16:36:42.963549 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.963537    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"e65dc80675c8819a77a4c48cfe539bef031aeab211d456c747b99fd2d1c1b4c1"}
Jul 10 16:36:42.963585 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.963568    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"c66e004cd286e70968c2bf89023dd5f6f71fe89ed1e862dd536e086addc26652"}
Jul 10 16:36:42.963618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.963595    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerDied","Data":"4d9eeae497213b1014565bfc0ca6df968676f15c6760abf114746927873c7c6c"}
Jul 10 16:36:42.963660 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.963623    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"c675e29ab5399460786a7b8d8cfe910e7838867865664301e4087aed9aabc8c9"}
Jul 10 16:36:42.964775 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.964757    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hp4m4" event={"ID":"0f05421e-33ce-47da-907f-558c5b2dedbc","Type":"ContainerStarted","Data":"6363b4dfc3bb9c1ef76d5ab63faeac70e7fdecf769b3ddf6f9bf43c81a7d68a2"}
Jul 10 16:36:42.966014 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.965996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7f427" event={"ID":"76c5f1d2-ca9e-44a3-9a36-aba1253886ee","Type":"ContainerStarted","Data":"b85047f91187f8c4cbecc2c8993fedd2b135a7763f6d7ee8c214f9c9b151cc8b"}
Jul 10 16:36:42.967373 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.967356    2574 generic.go:356] "Generic (PLEG): container finished" podID="88d91a45-22a3-45f0-b800-125650e7d68b" containerID="49cd30dc3349bb4346c9e064c2aba3f0d1974bd8027fad4cfeeb8f5ac397cdd0" exitCode=0
Jul 10 16:36:42.967427 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.967414    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkht" event={"ID":"88d91a45-22a3-45f0-b800-125650e7d68b","Type":"ContainerDied","Data":"49cd30dc3349bb4346c9e064c2aba3f0d1974bd8027fad4cfeeb8f5ac397cdd0"}
Jul 10 16:36:42.968900 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.968877    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wlr8h" event={"ID":"d2573b8a-2be3-4ba0-9b55-6848ae4f91f8","Type":"ContainerStarted","Data":"3cb8951ac83b482ba1a7af6b1975a1637a3871732cecf73acaf777035ee837ca"}
Jul 10 16:36:42.970251 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.970229    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rbzv8" event={"ID":"22f59fc7-5213-4c46-bb56-375112bb3e54","Type":"ContainerStarted","Data":"f1dc4ad49c0a4033d946cdf07b8954dc2e617a9c1c024941efb4c268f92f499a"}
Jul 10 16:36:42.972003 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:42.971985    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz" event={"ID":"ccbeb788-f3e1-4436-9520-58ee40393d6a","Type":"ContainerStarted","Data":"517ad9199bacefc19e46988a84ff92eac0a9a2ad9ab8eecfffbee1af6ae4ba46"}
Jul 10 16:36:43.003520 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.003478    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wlr8h" podStartSLOduration=2.879026615 podStartE2EDuration="23.003464677s" totalImagesPullingTime="20.124438062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:43.003178626 +0000 UTC m=+23.603354282" watchObservedRunningTime="2026-07-10 16:36:43.003464677 +0000 UTC m=+23.603640332"
Jul 10 16:36:43.030461 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.030385    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hp4m4" podStartSLOduration=2.875980463 podStartE2EDuration="23.030372023s" totalImagesPullingTime="20.15439156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:43.020987395 +0000 UTC m=+23.621163050" watchObservedRunningTime="2026-07-10 16:36:43.030372023 +0000 UTC m=+23.630547678"
Jul 10 16:36:43.048074 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.048022    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rbzv8" podStartSLOduration=11.458143856 podStartE2EDuration="23.048002601s" totalImagesPullingTime="11.589858745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:43.047878168 +0000 UTC m=+23.648053822" watchObservedRunningTime="2026-07-10 16:36:43.048002601 +0000 UTC m=+23.648178260"
Jul 10 16:36:43.861985 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.861904    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:43.862393 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.861901    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:43.862393 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:43.862029    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:43.862393 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:43.862074    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:43.976611 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.976547    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zrblm" event={"ID":"fefb9913-a6f3-477a-af16-8fd08cd8d2b3","Type":"ContainerStarted","Data":"123e3248b28833028ff6c86cc20e83d46d4e6e7e851260662086a6c59af8cab5"}
Jul 10 16:36:43.981372 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.981349    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:36:43.981869 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.981800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"aafe74e824e868fad1f2d863d49668abc8cfbf0acfd17b7ce506bee025469482"}
Jul 10 16:36:43.992077 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.992026    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zrblm" podStartSLOduration=11.495361298 podStartE2EDuration="22.992006893s" totalImagesPullingTime="11.496645595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:43.991854155 +0000 UTC m=+24.592029810" watchObservedRunningTime="2026-07-10 16:36:43.992006893 +0000 UTC m=+24.592182549"
Jul 10 16:36:43.992500 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:43.992472    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7f427" podStartSLOduration=11.470120667 podStartE2EDuration="22.992465339s" totalImagesPullingTime="11.522344672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:43.081060726 +0000 UTC m=+23.681236381" watchObservedRunningTime="2026-07-10 16:36:43.992465339 +0000 UTC m=+24.592641000"
Jul 10 16:36:44.861462 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:44.861427    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:44.861659 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:44.861594    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:45.861819 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:45.861654    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:45.862328 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:45.861653    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:45.862328 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:45.861897    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:45.862328 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:45.861987    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:45.990117 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:45.990083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz" event={"ID":"ccbeb788-f3e1-4436-9520-58ee40393d6a","Type":"ContainerStarted","Data":"c1eaed9cf8b0671523c5407fb5ad4d3b0f97f3eb92d9fa1094a0a863822f6d69"}
Jul 10 16:36:45.995886 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:45.995863    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:36:45.996199 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:45.996179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"11a20e4fd8683aacfaf19675cba443df98a1d507888d160de846a9ca99df9300"}
Jul 10 16:36:46.861878 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:46.861848    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:46.862332 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:46.861976    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:47.861394 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:47.861365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:47.861553 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:47.861368    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:47.861553 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:47.861496    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:47.861674 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:47.861571    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:48.861394 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:48.861153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:48.861831 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:48.861521    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:49.005463 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.005392    2574 generic.go:356] "Generic (PLEG): container finished" podID="88d91a45-22a3-45f0-b800-125650e7d68b" containerID="b61cf2b33c07ac275b843dc2e0d7f5203b616a2564f7371355972ee97d80625d" exitCode=0
Jul 10 16:36:49.005601 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.005478    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkht" event={"ID":"88d91a45-22a3-45f0-b800-125650e7d68b","Type":"ContainerDied","Data":"b61cf2b33c07ac275b843dc2e0d7f5203b616a2564f7371355972ee97d80625d"}
Jul 10 16:36:49.009014 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.008996    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:36:49.009379 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.009358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"c4d984fb82f89a8a178f38fb90dfcd2a5ff60870105078793a8dfa8deab135c7"}
Jul 10 16:36:49.009696 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.009677    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:49.009886 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.009870    2574 scope.go:117] "RemoveContainer" containerID="4d9eeae497213b1014565bfc0ca6df968676f15c6760abf114746927873c7c6c"
Jul 10 16:36:49.025176 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.025152    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:49.033600 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.033560    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hmsdz" podStartSLOduration=6.067639416 podStartE2EDuration="29.033545346s" totalImagesPullingTime="22.96590593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:46.023118943 +0000 UTC m=+26.623294608" watchObservedRunningTime="2026-07-10 16:36:49.033545346 +0000 UTC m=+29.633721000"
Jul 10 16:36:49.862303 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.862267    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:49.862762 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:49.862318    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:49.862762 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:49.862390    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:49.862762 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:49.862497    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:50.016660 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.016578    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:36:50.017130 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.017101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" event={"ID":"2179c8ae-e467-4b7f-ab15-25c286eb1d3b","Type":"ContainerStarted","Data":"5e66858c0b589820ae8b3791c75b3cc5b5e3a5e9b410c019ee1b027a789127f0"}
Jul 10 16:36:50.017439 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.017418    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:50.017554 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.017483    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:50.033036 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.033013    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:36:50.048132 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.048073    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bn486" podStartSLOduration=9.716380132 podStartE2EDuration="30.048049222s" totalImagesPullingTime="20.33166909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:36:50.047121048 +0000 UTC m=+30.647296702" watchObservedRunningTime="2026-07-10 16:36:50.048049222 +0000 UTC m=+30.648224879"
Jul 10 16:36:50.514157 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.513954    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qlswx"]
Jul 10 16:36:50.514310 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.514276    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:50.514405 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:50.514384    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:50.517734 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.517702    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vcldr"]
Jul 10 16:36:50.517882 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.517830    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:50.517970 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:50.517944    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:50.518464 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.518437    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sl5ck"]
Jul 10 16:36:50.518562 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:50.518546    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:50.518658 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:50.518639    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:51.021857 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:51.021824    2574 generic.go:356] "Generic (PLEG): container finished" podID="88d91a45-22a3-45f0-b800-125650e7d68b" containerID="c9bf6d1d9f143f59f2855681a75f43cc72ad81ce91a08f560800493e6809898c" exitCode=0
Jul 10 16:36:51.022302 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:51.021909    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkht" event={"ID":"88d91a45-22a3-45f0-b800-125650e7d68b","Type":"ContainerDied","Data":"c9bf6d1d9f143f59f2855681a75f43cc72ad81ce91a08f560800493e6809898c"}
Jul 10 16:36:51.861547 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:51.861518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:51.861726 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:51.861652    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:51.861726 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:51.861717    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:51.861838 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:51.861799    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:52.861689 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:52.861619    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:52.862326 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:52.861723    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:53.028366 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:53.028335    2574 generic.go:356] "Generic (PLEG): container finished" podID="88d91a45-22a3-45f0-b800-125650e7d68b" containerID="b40b9975a2d4319300a18203bcbe1b8391c850fef5e42663f25a262e51f5abc3" exitCode=0
Jul 10 16:36:53.028516 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:53.028388    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkht" event={"ID":"88d91a45-22a3-45f0-b800-125650e7d68b","Type":"ContainerDied","Data":"b40b9975a2d4319300a18203bcbe1b8391c850fef5e42663f25a262e51f5abc3"}
Jul 10 16:36:53.491005 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:53.490966    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:53.491192 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:53.491020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:53.491192 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.491139    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:53.491307 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.491207    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:37:25.491188257 +0000 UTC m=+66.091363895 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 16:36:53.491307 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.491141    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 16:36:53.491307 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.491270    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 16:36:53.491307 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.491284    2574 projected.go:196] Error preparing data for projected volume kube-api-access-tvbxs for pod openshift-network-diagnostics/network-check-target-vcldr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:53.491470 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.491331    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs podName:b6e6239e-bdd2-4137-846a-d32c6d773030 nodeName:}" failed. No retries permitted until 2026-07-10 16:37:25.491318503 +0000 UTC m=+66.091494138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tvbxs" (UniqueName: "kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs") pod "network-check-target-vcldr" (UID: "b6e6239e-bdd2-4137-846a-d32c6d773030") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 16:36:53.591364 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:53.591333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:53.591518 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.591442    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:53.591518 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.591492    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret podName:f199d4f9-fbed-411d-ac9a-9fabecf00c50 nodeName:}" failed. No retries permitted until 2026-07-10 16:37:25.591479183 +0000 UTC m=+66.191654816 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret") pod "global-pull-secret-syncer-sl5ck" (UID: "f199d4f9-fbed-411d-ac9a-9fabecf00c50") : object "kube-system"/"original-pull-secret" not registered
Jul 10 16:36:53.864715 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:53.864642    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:53.865125 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.864768    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcldr" podUID="b6e6239e-bdd2-4137-846a-d32c6d773030"
Jul 10 16:36:53.865125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:53.864792    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:53.865125 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:53.864907    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:36:54.861289 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:54.861118    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:54.861445 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:54.861360    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl5ck" podUID="f199d4f9-fbed-411d-ac9a-9fabecf00c50"
Jul 10 16:36:55.205539 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.205512    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-50.ec2.internal" event="NodeReady"
Jul 10 16:36:55.206008 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.205661    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 16:36:55.238811 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.238774    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"]
Jul 10 16:36:55.242167 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.242147    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:55.245405 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.245381    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 10 16:36:55.245405 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.245398    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-csvlq\""
Jul 10 16:36:55.245562 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.245386    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 10 16:36:55.248345 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.248317    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76df47bc4c-89j6t"]
Jul 10 16:36:55.252424 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.252405    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.253179 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.253159    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"]
Jul 10 16:36:55.255356 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.255338    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j2fhq"]
Jul 10 16:36:55.255444 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.255427    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 16:36:55.255822 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.255801    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 16:36:55.255822 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.255821    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kj2p2\""
Jul 10 16:36:55.256201 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.256182    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 16:36:55.259288 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.259268    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tjchb"]
Jul 10 16:36:55.259375 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.259338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.261781 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.261765    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 16:36:55.262537 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.262516    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 16:36:55.262731 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.262708    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jqrx8\""
Jul 10 16:36:55.262995 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.262555    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 16:36:55.265717 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.265697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tjchb"
Jul 10 16:36:55.267156 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.267136    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76df47bc4c-89j6t"]
Jul 10 16:36:55.269583 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.269237    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 16:36:55.269583 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.269322    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 16:36:55.269583 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.269435    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 16:36:55.269583 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.269523    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xrt5s\""
Jul 10 16:36:55.271873 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.271860    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tjchb"]
Jul 10 16:36:55.273233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.272605    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j2fhq"]
Jul 10 16:36:55.302958 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.302910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/91942a10-f7ff-4dcd-935a-b55f45182a1d-config-volume\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.303125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.302964    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91942a10-f7ff-4dcd-935a-b55f45182a1d-tmp-dir\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.303125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.302999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-image-registry-private-configuration\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.303125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303024    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-bound-sa-token\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.303125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkk9v\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-kube-api-access-wkk9v\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.303125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303071    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:55.303336 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303144    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-installation-pull-secrets\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.303336 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303182    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-trusted-ca\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.303336 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303201    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.303336 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303216    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:55.303336 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.303555 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303343    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6fgb\" (UniqueName: \"kubernetes.io/projected/91942a10-f7ff-4dcd-935a-b55f45182a1d-kube-api-access-c6fgb\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.303555 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303394    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebfcdd4e-973e-42c7-b37b-010772cefa07-ca-trust-extracted\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.303555 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.303466    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-certificates\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.404708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.404671    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkk9v\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-kube-api-access-wkk9v\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.404708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.404707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:55.404901 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.404727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a552c5e-c995-4240-ad1d-fd4c0b548e02-cert\") pod \"ingress-canary-tjchb\" (UID: \"8a552c5e-c995-4240-ad1d-fd4c0b548e02\") " pod="openshift-ingress-canary/ingress-canary-tjchb"
Jul 10 16:36:55.404901 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.404763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-installation-pull-secrets\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.404901 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.404782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-trusted-ca\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.404901 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.404799    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.404901 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.404813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:55.404901 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.404817    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:36:55.404901 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.404899    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:36:55.904870052 +0000 UTC m=+36.505045688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.404985    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.405003    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.404999    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.405059    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:55.905040868 +0000 UTC m=+36.505216513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.405079    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.405142    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:36:55.905124448 +0000 UTC m=+36.505300085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6fgb\" (UniqueName: \"kubernetes.io/projected/91942a10-f7ff-4dcd-935a-b55f45182a1d-kube-api-access-c6fgb\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405218    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebfcdd4e-973e-42c7-b37b-010772cefa07-ca-trust-extracted\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.405286 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405270    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-certificates\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.405731 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405294    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/91942a10-f7ff-4dcd-935a-b55f45182a1d-config-volume\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.405731 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405317    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91942a10-f7ff-4dcd-935a-b55f45182a1d-tmp-dir\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.405731 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2tzx\" (UniqueName: \"kubernetes.io/projected/8a552c5e-c995-4240-ad1d-fd4c0b548e02-kube-api-access-f2tzx\") pod \"ingress-canary-tjchb\" (UID: \"8a552c5e-c995-4240-ad1d-fd4c0b548e02\") " pod="openshift-ingress-canary/ingress-canary-tjchb"
Jul 10 16:36:55.405731 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405386    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-image-registry-private-configuration\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.405731 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-bound-sa-token\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.405990 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405749    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91942a10-f7ff-4dcd-935a-b55f45182a1d-tmp-dir\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.405990 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405829    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-certificates\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.405990 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.405857    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-trusted-ca\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.406099 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.406045    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/91942a10-f7ff-4dcd-935a-b55f45182a1d-config-volume\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.406160 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.406139    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:55.406274 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.406258    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebfcdd4e-973e-42c7-b37b-010772cefa07-ca-trust-extracted\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.409234 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.409217    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-installation-pull-secrets\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.409234 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.409225    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-image-registry-private-configuration\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.413879 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.413857    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6fgb\" (UniqueName: \"kubernetes.io/projected/91942a10-f7ff-4dcd-935a-b55f45182a1d-kube-api-access-c6fgb\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.414003 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.413866    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkk9v\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-kube-api-access-wkk9v\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.414082 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.414063    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-bound-sa-token\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.505945 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.505821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2tzx\" (UniqueName: \"kubernetes.io/projected/8a552c5e-c995-4240-ad1d-fd4c0b548e02-kube-api-access-f2tzx\") pod \"ingress-canary-tjchb\" (UID: \"8a552c5e-c995-4240-ad1d-fd4c0b548e02\") " pod="openshift-ingress-canary/ingress-canary-tjchb"
Jul 10 16:36:55.505945 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.505874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a552c5e-c995-4240-ad1d-fd4c0b548e02-cert\") pod \"ingress-canary-tjchb\" (UID: \"8a552c5e-c995-4240-ad1d-fd4c0b548e02\") " pod="openshift-ingress-canary/ingress-canary-tjchb"
Jul 10 16:36:55.508477 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.508455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a552c5e-c995-4240-ad1d-fd4c0b548e02-cert\") pod \"ingress-canary-tjchb\" (UID: \"8a552c5e-c995-4240-ad1d-fd4c0b548e02\") " pod="openshift-ingress-canary/ingress-canary-tjchb"
Jul 10 16:36:55.514379 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.514351    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2tzx\" (UniqueName: \"kubernetes.io/projected/8a552c5e-c995-4240-ad1d-fd4c0b548e02-kube-api-access-f2tzx\") pod \"ingress-canary-tjchb\" (UID: \"8a552c5e-c995-4240-ad1d-fd4c0b548e02\") " pod="openshift-ingress-canary/ingress-canary-tjchb"
Jul 10 16:36:55.582686 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.582651    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tjchb"
Jul 10 16:36:55.716522 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.716486    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tjchb"]
Jul 10 16:36:55.721300 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:36:55.721268    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a552c5e_c995_4240_ad1d_fd4c0b548e02.slice/crio-b5086fe1752cef5e62457cfe030355ee51cdd11da6a79614dac69a959f8e257b WatchSource:0}: Error finding container b5086fe1752cef5e62457cfe030355ee51cdd11da6a79614dac69a959f8e257b: Status 404 returned error can't find the container with id b5086fe1752cef5e62457cfe030355ee51cdd11da6a79614dac69a959f8e257b
Jul 10 16:36:55.861968 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.861858    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:36:55.862135 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.861858    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:36:55.865596 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.865572    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ggg2b\""
Jul 10 16:36:55.865738 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.865634    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 16:36:55.865807 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.865738    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bc5mm\""
Jul 10 16:36:55.865867 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.865844    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 16:36:55.865944 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.865915    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 16:36:55.910760 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.910729    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:55.910903 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.910773    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:55.910903 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:55.910792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:55.910903 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.910872    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:36:55.910903 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.910898    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:36:55.911100 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.910917    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:36:55.911100 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.910922    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:36:56.910909501 +0000 UTC m=+37.511085134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:36:55.911100 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.910945    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:36:55.911100 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.911000    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:36:56.910985066 +0000 UTC m=+37.511160703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:36:55.911100 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:55.911015    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:56.911009092 +0000 UTC m=+37.511184725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:36:56.036943 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:56.036903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tjchb" event={"ID":"8a552c5e-c995-4240-ad1d-fd4c0b548e02","Type":"ContainerStarted","Data":"b5086fe1752cef5e62457cfe030355ee51cdd11da6a79614dac69a959f8e257b"}
Jul 10 16:36:56.861823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:56.861782    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:36:56.865426 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:56.865406    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 16:36:56.922567 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:56.922536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:56.922567 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:56.922570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:56.922822 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:56.922663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:56.922822 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:56.922733    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:36:56.922822 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:56.922750    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:36:56.922822 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:56.922801    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:36:56.923046 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:56.922849    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:36:56.923046 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:56.922811    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:36:58.922788847 +0000 UTC m=+39.522964496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:36:56.923046 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:56.922910    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:36:58.922897508 +0000 UTC m=+39.523073147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:36:56.923046 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:56.922924    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:36:58.922916076 +0000 UTC m=+39.523091711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:36:57.436497 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:57.436456    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:36:57.571655 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:57.571614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:36:58.940292 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:58.940245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:36:58.940292 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:58.940296    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:36:58.940821 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:58.940389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:36:58.940821 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:58.940422    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:36:58.940821 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:58.940444    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:36:58.940821 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:58.940486    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:36:58.940821 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:58.940494    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:36:58.940821 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:58.940501    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:37:02.940484573 +0000 UTC m=+43.540660206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:36:58.940821 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:58.940540    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:37:02.940528208 +0000 UTC m=+43.540703842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:36:58.940821 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:36:58.940554    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:37:02.940545157 +0000 UTC m=+43.540720791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:36:59.363754 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:59.363672    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:36:59.416294 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:36:59.416259    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:00.047030 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:00.046945    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tjchb" event={"ID":"8a552c5e-c995-4240-ad1d-fd4c0b548e02","Type":"ContainerStarted","Data":"d05646e50df9e17130843e19055bb66d3d1595f3d11a017a03909583fa276bf5"}
Jul 10 16:37:00.049627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:00.049602    2574 generic.go:356] "Generic (PLEG): container finished" podID="88d91a45-22a3-45f0-b800-125650e7d68b" containerID="15da32084307f8228e959d2e1e261f2537f3feef81c2b654d5e6ff8e9e488fcc" exitCode=0
Jul 10 16:37:00.049765 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:00.049637    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkht" event={"ID":"88d91a45-22a3-45f0-b800-125650e7d68b","Type":"ContainerDied","Data":"15da32084307f8228e959d2e1e261f2537f3feef81c2b654d5e6ff8e9e488fcc"}
Jul 10 16:37:00.063667 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:00.063624    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tjchb" podStartSLOduration=1.317648353 podStartE2EDuration="5.063608808s" totalImagesPullingTime="3.745960455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:37:00.062917844 +0000 UTC m=+40.663093525" watchObservedRunningTime="2026-07-10 16:37:00.063608808 +0000 UTC m=+40.663784490"
Jul 10 16:37:00.951058 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:00.951016    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:01.054143 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:01.054103    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:01.055627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:01.055591    2574 generic.go:356] "Generic (PLEG): container finished" podID="88d91a45-22a3-45f0-b800-125650e7d68b" containerID="76dd324cc27c14139c03e36187753f784fd4aeffbccf1b27dee9f606e643f855" exitCode=0
Jul 10 16:37:01.055746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:01.055671    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkht" event={"ID":"88d91a45-22a3-45f0-b800-125650e7d68b","Type":"ContainerDied","Data":"76dd324cc27c14139c03e36187753f784fd4aeffbccf1b27dee9f606e643f855"}
Jul 10 16:37:01.666090 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:01.666055    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:01.725318 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:01.725283    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:02.061059 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:02.060972    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tvkht" event={"ID":"88d91a45-22a3-45f0-b800-125650e7d68b","Type":"ContainerStarted","Data":"5d8153b213ed12caab7376826d4c4198fefe81e2ebb041783b0a7253517732b8"}
Jul 10 16:37:02.090431 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:02.090384    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tvkht" podStartSLOduration=15.847745092 podStartE2EDuration="42.090370413s" totalImagesPullingTime="26.242625321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:37:02.088882739 +0000 UTC m=+42.689058394" watchObservedRunningTime="2026-07-10 16:37:02.090370413 +0000 UTC m=+42.690546046"
Jul 10 16:37:02.227346 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:02.227316    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:02.365563 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:02.365469    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:02.971544 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:02.971503    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:37:02.971745 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:02.971553    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:37:02.971745 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:02.971572    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:37:02.971745 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:02.971654    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:37:02.971745 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:02.971669    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:37:02.971745 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:02.971679    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:37:02.971745 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:02.971698    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:37:02.971745 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:02.971721    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:37:10.971707765 +0000 UTC m=+51.571883397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:37:02.971745 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:02.971743    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:37:10.971726183 +0000 UTC m=+51.571901829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:37:02.972058 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:02.971761    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:37:10.971751859 +0000 UTC m=+51.571927491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:37:11.031395 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:11.031359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:11.031404    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:11.031425    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:11.031501    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:11.031520    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:11.031539    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:11.031555    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:37:27.031539912 +0000 UTC m=+67.631715545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:11.031505    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:11.031614    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:37:27.03159542 +0000 UTC m=+67.631771058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:37:11.031951 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:11.031647    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:37:27.031630119 +0000 UTC m=+67.631805755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:37:13.325478 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:13.325446    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:13.421103 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:13.421073    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:13.521742 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:13.521715    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:13.585087 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:13.585007    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:14.342177 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:14.342147    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:14.404619 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:14.404589    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:21.633737 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:21.633701    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:21.734001 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:21.733966    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:22.035067 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:22.035041    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bn486"
Jul 10 16:37:22.194110 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:22.194072    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:22.294399 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:22.294314    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:22.605331 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:22.605238    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:25.541459 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.541420    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:37:25.541459 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.541465    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:37:25.544577 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.544555    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 16:37:25.544660 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.544610    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 16:37:25.551887 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:25.551860    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 16:37:25.552010 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:25.551923    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:38:29.551906546 +0000 UTC m=+130.152082182 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : secret "metrics-daemon-secret" not found
Jul 10 16:37:25.554147 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.554130    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 16:37:25.565373 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.565354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvbxs\" (UniqueName: \"kubernetes.io/projected/b6e6239e-bdd2-4137-846a-d32c6d773030-kube-api-access-tvbxs\") pod \"network-check-target-vcldr\" (UID: \"b6e6239e-bdd2-4137-846a-d32c6d773030\") " pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:37:25.575861 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.575843    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ggg2b\""
Jul 10 16:37:25.584073 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.584055    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:37:25.642432 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.642370    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:37:25.645893 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.645650    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 16:37:25.655572 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.655517    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f199d4f9-fbed-411d-ac9a-9fabecf00c50-original-pull-secret\") pod \"global-pull-secret-syncer-sl5ck\" (UID: \"f199d4f9-fbed-411d-ac9a-9fabecf00c50\") " pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:37:25.674220 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.674164    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl5ck"
Jul 10 16:37:25.704911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.704880    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vcldr"]
Jul 10 16:37:25.709628 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:37:25.709597    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e6239e_bdd2_4137_846a_d32c6d773030.slice/crio-8e74321641048219857374e28b5f4df97f3770a74ae6d4c4e6950dfcc953de15 WatchSource:0}: Error finding container 8e74321641048219857374e28b5f4df97f3770a74ae6d4c4e6950dfcc953de15: Status 404 returned error can't find the container with id 8e74321641048219857374e28b5f4df97f3770a74ae6d4c4e6950dfcc953de15
Jul 10 16:37:25.794508 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:25.794438    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sl5ck"]
Jul 10 16:37:25.797414 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:37:25.797387    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf199d4f9_fbed_411d_ac9a_9fabecf00c50.slice/crio-e18ca884e4e30b70189f752c057811deaf021578847f5afa5a8ac31e35f107ca WatchSource:0}: Error finding container e18ca884e4e30b70189f752c057811deaf021578847f5afa5a8ac31e35f107ca: Status 404 returned error can't find the container with id e18ca884e4e30b70189f752c057811deaf021578847f5afa5a8ac31e35f107ca
Jul 10 16:37:26.119511 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:26.119417    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vcldr" event={"ID":"b6e6239e-bdd2-4137-846a-d32c6d773030","Type":"ContainerStarted","Data":"8e74321641048219857374e28b5f4df97f3770a74ae6d4c4e6950dfcc953de15"}
Jul 10 16:37:26.120449 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:26.120428    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sl5ck" event={"ID":"f199d4f9-fbed-411d-ac9a-9fabecf00c50","Type":"ContainerStarted","Data":"e18ca884e4e30b70189f752c057811deaf021578847f5afa5a8ac31e35f107ca"}
Jul 10 16:37:26.726999 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:26.726953    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:26.825413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:26.825381    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:27.052457 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:27.052367    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:37:27.052457 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:27.052421    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:37:27.052663 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:27.052501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:37:27.052663 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:27.052538    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:37:27.052663 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:27.052561    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:37:27.052663 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:27.052568    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:37:27.052663 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:27.052614    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:37:27.052663 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:27.052626    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:37:59.052609954 +0000 UTC m=+99.652785587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:37:27.052663 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:27.052647    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:37:59.052638032 +0000 UTC m=+99.652813666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:37:27.052663 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:27.052669    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:37:59.052652597 +0000 UTC m=+99.652828242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:37:29.845893 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:29.845854    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:29.896873 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:29.896843    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:31.429115 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:31.429068    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:31.506430 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:31.506393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:32.137402 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:32.137365    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sl5ck" event={"ID":"f199d4f9-fbed-411d-ac9a-9fabecf00c50","Type":"ContainerStarted","Data":"c04b5fb71c17481d603832360403c0fd26eb142e9a1bdd03e076ca6b64905a71"}
Jul 10 16:37:32.138824 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:32.138796    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vcldr" event={"ID":"b6e6239e-bdd2-4137-846a-d32c6d773030","Type":"ContainerStarted","Data":"0088e3325c6a8adbe6d532303f78efd36df233a0a1adafd1d7566d181e313232"}
Jul 10 16:37:32.138972 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:32.138949    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:37:32.154148 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:32.154102    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sl5ck" podStartSLOduration=65.652745047 podStartE2EDuration="1m11.154089836s" totalImagesPullingTime="5.501344789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:37:32.153388777 +0000 UTC m=+72.753564431" watchObservedRunningTime="2026-07-10 16:37:32.154089836 +0000 UTC m=+72.754265490"
Jul 10 16:37:32.169406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:32.169352    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vcldr" podStartSLOduration=66.583798465 podStartE2EDuration="1m12.169338666s" totalImagesPullingTime="5.585540201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:37:32.168982505 +0000 UTC m=+72.769158157" watchObservedRunningTime="2026-07-10 16:37:32.169338666 +0000 UTC m=+72.769514321"
Jul 10 16:37:52.387206 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:52.387065    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:52.452810 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:52.452772    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:52.509681 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:52.509649    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:37:59.072243 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:59.072202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:59.072253    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:37:59.072273    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:59.072356    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:59.072370    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:59.072376    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:59.072395    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:59.072434    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:39:03.072416523 +0000 UTC m=+163.672592156 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:59.072456    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:39:03.072440451 +0000 UTC m=+163.672616084 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:37:59.072776 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:37:59.072474    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:39:03.072465465 +0000 UTC m=+163.672641101 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:38:03.143656 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:38:03.143625    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vcldr"
Jul 10 16:38:29.595939 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:38:29.595898    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:38:29.596421 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:38:29.596049    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 16:38:29.596421 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:38:29.596123    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:31.596107053 +0000 UTC m=+252.196282689 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : secret "metrics-daemon-secret" not found
Jul 10 16:38:58.252672 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:38:58.252613    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr" podUID="c595dc1c-3846-4b2a-a102-eaa6f7f02a6b"
Jul 10 16:38:58.264735 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:38:58.264708    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" podUID="ebfcdd4e-973e-42c7-b37b-010772cefa07"
Jul 10 16:38:58.277954 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:38:58.277919    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j2fhq" podUID="91942a10-f7ff-4dcd-935a-b55f45182a1d"
Jul 10 16:38:58.336652 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:38:58.336624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:38:58.336793 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:38:58.336624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:38:58.336860 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:38:58.336624    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:38:58.876854 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:38:58.876808    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:39:03.123952 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:39:03.123884    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:39:03.123970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:39:03.124000    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:39:03.124045    2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:39:03.124113    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert podName:c595dc1c-3846-4b2a-a102-eaa6f7f02a6b nodeName:}" failed. No retries permitted until 2026-07-10 16:41:05.124097492 +0000 UTC m=+285.724273125 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rwhkr" (UID: "c595dc1c-3846-4b2a-a102-eaa6f7f02a6b") : secret "networking-console-plugin-cert" not found
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:39:03.124115    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:39:03.124134    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76df47bc4c-89j6t: secret "image-registry-tls" not found
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:39:03.124140    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:39:03.124190    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls podName:ebfcdd4e-973e-42c7-b37b-010772cefa07 nodeName:}" failed. No retries permitted until 2026-07-10 16:41:05.124171936 +0000 UTC m=+285.724347586 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls") pod "image-registry-76df47bc4c-89j6t" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07") : secret "image-registry-tls" not found
Jul 10 16:39:03.124410 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:39:03.124204    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls podName:91942a10-f7ff-4dcd-935a-b55f45182a1d nodeName:}" failed. No retries permitted until 2026-07-10 16:41:05.124197863 +0000 UTC m=+285.724373495 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls") pod "dns-default-j2fhq" (UID: "91942a10-f7ff-4dcd-935a-b55f45182a1d") : secret "dns-default-metrics-tls" not found
Jul 10 16:39:13.861915 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:39:13.861839    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:40:31.617760 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:31.617717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:40:31.618267 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:31.617868    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 16:40:31.618267 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:31.617941    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs podName:6df769b8-14bb-4309-b135-f356e95f75e1 nodeName:}" failed. No retries permitted until 2026-07-10 16:42:33.617910683 +0000 UTC m=+374.218086316 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs") pod "network-metrics-daemon-qlswx" (UID: "6df769b8-14bb-4309-b135-f356e95f75e1") : secret "metrics-daemon-secret" not found
Jul 10 16:40:32.240284 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.240249    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5"]
Jul 10 16:40:32.243051 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.243035    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf"]
Jul 10 16:40:32.243161 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.243147    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5"
Jul 10 16:40:32.245537 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.245518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf"
Jul 10 16:40:32.246362 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.246347    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 10 16:40:32.247499 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.247475    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v6kk2\""
Jul 10 16:40:32.247595 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.247526    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 10 16:40:32.248398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.248378    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vzncq\""
Jul 10 16:40:32.248606 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.248578    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-bbclc"]
Jul 10 16:40:32.251630 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.251614    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.255014 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.254992    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 10 16:40:32.255215 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.255036    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 10 16:40:32.257347 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.257076    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 10 16:40:32.257461 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.257446    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-smv27\""
Jul 10 16:40:32.258527 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.257675    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 10 16:40:32.262349 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.262277    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 10 16:40:32.263368 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.263349    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5"]
Jul 10 16:40:32.264250 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.264228    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf"]
Jul 10 16:40:32.278119 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.278096    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-bbclc"]
Jul 10 16:40:32.321621 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.321590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpv7z\" (UniqueName: \"kubernetes.io/projected/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-kube-api-access-gpv7z\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.321767 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.321645    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgtt6\" (UniqueName: \"kubernetes.io/projected/38ef6130-1742-4bc2-bf7e-dc0ac8463794-kube-api-access-wgtt6\") pod \"network-check-source-869dcfcdcd-lwqgf\" (UID: \"38ef6130-1742-4bc2-bf7e-dc0ac8463794\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf"
Jul 10 16:40:32.321767 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.321707    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-serving-cert\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.321767 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.321751    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-config\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.321869 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.321778    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l6c4\" (UniqueName: \"kubernetes.io/projected/49d99475-2140-4169-84d3-27a7597390be-kube-api-access-5l6c4\") pod \"volume-data-source-validator-78495597f6-fnjr5\" (UID: \"49d99475-2140-4169-84d3-27a7597390be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5"
Jul 10 16:40:32.321869 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.321808    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-trusted-ca\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.335073 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.335045    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"]
Jul 10 16:40:32.337911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.337897    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.342311 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.342287    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"]
Jul 10 16:40:32.344569 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.344545    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-54r5p\""
Jul 10 16:40:32.345215 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.345155    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 10 16:40:32.345215 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.345158    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 16:40:32.345215 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.345189    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 16:40:32.345419 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.345234    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"]
Jul 10 16:40:32.345471 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.345422    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.345617 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.345527    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 10 16:40:32.348113 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.348094    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pvc2q"]
Jul 10 16:40:32.348239 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.348208    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:32.348824 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.348807    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-n4gnl\""
Jul 10 16:40:32.348904 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.348856    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 10 16:40:32.348904 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.348877    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 10 16:40:32.349111 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.348907    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 10 16:40:32.349203 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.349142    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 10 16:40:32.350769 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.350752    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.352789 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.352769    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j4rz7\""
Jul 10 16:40:32.352908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.352892    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 10 16:40:32.353153 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.353134    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 10 16:40:32.353153 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.353125    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 10 16:40:32.353506 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.353483    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 10 16:40:32.353604 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.353552    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 16:40:32.353604 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.353493    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 16:40:32.354007 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.353533    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 10 16:40:32.354007 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.353493    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-glmns\""
Jul 10 16:40:32.354007 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.353820    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"]
Jul 10 16:40:32.359780 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.359674    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"]
Jul 10 16:40:32.360827 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.360809    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pvc2q"]
Jul 10 16:40:32.361753 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.361730    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 10 16:40:32.363564 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.363545    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"]
Jul 10 16:40:32.422299 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-serving-cert\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.422299 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422303    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d938d7cc-0963-475b-a3df-3fa971f5a497-config\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.422465 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ada96f-0a98-4af7-b788-799c1c27bf8d-serving-cert\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.422465 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-config\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.422465 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422400    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d938d7cc-0963-475b-a3df-3fa971f5a497-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.422465 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l6c4\" (UniqueName: \"kubernetes.io/projected/49d99475-2140-4169-84d3-27a7597390be-kube-api-access-5l6c4\") pod \"volume-data-source-validator-78495597f6-fnjr5\" (UID: \"49d99475-2140-4169-84d3-27a7597390be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5"
Jul 10 16:40:32.422627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422476    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ada96f-0a98-4af7-b788-799c1c27bf8d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.422627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ada96f-0a98-4af7-b788-799c1c27bf8d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.422627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpv7z\" (UniqueName: \"kubernetes.io/projected/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-kube-api-access-gpv7z\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.422627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422549    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgtt6\" (UniqueName: \"kubernetes.io/projected/38ef6130-1742-4bc2-bf7e-dc0ac8463794-kube-api-access-wgtt6\") pod \"network-check-source-869dcfcdcd-lwqgf\" (UID: \"38ef6130-1742-4bc2-bf7e-dc0ac8463794\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf"
Jul 10 16:40:32.422627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422595    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmg4h\" (UniqueName: \"kubernetes.io/projected/20967626-d110-4b59-9396-ddb0e8f3fa23-kube-api-access-hmg4h\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.422846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422667    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:32.422846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422704    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20967626-d110-4b59-9396-ddb0e8f3fa23-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.422846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422728    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-865vr\" (UniqueName: \"kubernetes.io/projected/0b4ac720-3126-41d8-b87e-417cc38c9148-kube-api-access-865vr\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:32.422846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ada96f-0a98-4af7-b788-799c1c27bf8d-tmp\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.422846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422788    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0ada96f-0a98-4af7-b788-799c1c27bf8d-snapshots\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.422846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5hmr\" (UniqueName: \"kubernetes.io/projected/d938d7cc-0963-475b-a3df-3fa971f5a497-kube-api-access-v5hmr\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.423161 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-trusted-ca\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.423161 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9xw\" (UniqueName: \"kubernetes.io/projected/c0ada96f-0a98-4af7-b788-799c1c27bf8d-kube-api-access-6b9xw\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.423161 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.422890    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.423161 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.423047    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-config\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.423690 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.423669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-trusted-ca\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.424598 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.424583    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-serving-cert\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.432568 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.432542    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpv7z\" (UniqueName: \"kubernetes.io/projected/575c4bf2-e2ac-41e4-86c6-d5705cc47db6-kube-api-access-gpv7z\") pod \"console-operator-7866497494-bbclc\" (UID: \"575c4bf2-e2ac-41e4-86c6-d5705cc47db6\") " pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.432664 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.432567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgtt6\" (UniqueName: \"kubernetes.io/projected/38ef6130-1742-4bc2-bf7e-dc0ac8463794-kube-api-access-wgtt6\") pod \"network-check-source-869dcfcdcd-lwqgf\" (UID: \"38ef6130-1742-4bc2-bf7e-dc0ac8463794\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf"
Jul 10 16:40:32.433309 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.433291    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l6c4\" (UniqueName: \"kubernetes.io/projected/49d99475-2140-4169-84d3-27a7597390be-kube-api-access-5l6c4\") pod \"volume-data-source-validator-78495597f6-fnjr5\" (UID: \"49d99475-2140-4169-84d3-27a7597390be\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5"
Jul 10 16:40:32.523611 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523506    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.523611 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523572    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d938d7cc-0963-475b-a3df-3fa971f5a497-config\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.523611 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ada96f-0a98-4af7-b788-799c1c27bf8d-serving-cert\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d938d7cc-0963-475b-a3df-3fa971f5a497-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523648    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ada96f-0a98-4af7-b788-799c1c27bf8d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:32.523656    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:32.523732    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls podName:20967626-d110-4b59-9396-ddb0e8f3fa23 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:33.02371428 +0000 UTC m=+253.623889913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wwbqt" (UID: "20967626-d110-4b59-9396-ddb0e8f3fa23") : secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ada96f-0a98-4af7-b788-799c1c27bf8d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523777    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmg4h\" (UniqueName: \"kubernetes.io/projected/20967626-d110-4b59-9396-ddb0e8f3fa23-kube-api-access-hmg4h\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523864    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20967626-d110-4b59-9396-ddb0e8f3fa23-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.523911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-865vr\" (UniqueName: \"kubernetes.io/projected/0b4ac720-3126-41d8-b87e-417cc38c9148-kube-api-access-865vr\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:32.524412 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ada96f-0a98-4af7-b788-799c1c27bf8d-tmp\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.524412 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.523973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0ada96f-0a98-4af7-b788-799c1c27bf8d-snapshots\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.524412 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.524004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5hmr\" (UniqueName: \"kubernetes.io/projected/d938d7cc-0963-475b-a3df-3fa971f5a497-kube-api-access-v5hmr\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.524412 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.524040    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9xw\" (UniqueName: \"kubernetes.io/projected/c0ada96f-0a98-4af7-b788-799c1c27bf8d-kube-api-access-6b9xw\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.524412 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:32.524134    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 16:40:32.524412 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:32.524192    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls podName:0b4ac720-3126-41d8-b87e-417cc38c9148 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:33.024176689 +0000 UTC m=+253.624352331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gwqq" (UID: "0b4ac720-3126-41d8-b87e-417cc38c9148") : secret "samples-operator-tls" not found
Jul 10 16:40:32.524412 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.524347    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ada96f-0a98-4af7-b788-799c1c27bf8d-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.524412 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.524402    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d938d7cc-0963-475b-a3df-3fa971f5a497-config\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.524805 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.524514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ada96f-0a98-4af7-b788-799c1c27bf8d-tmp\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.524805 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.524699    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20967626-d110-4b59-9396-ddb0e8f3fa23-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.524805 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.524762    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c0ada96f-0a98-4af7-b788-799c1c27bf8d-snapshots\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.524805 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.524761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ada96f-0a98-4af7-b788-799c1c27bf8d-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.526205 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.526183    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d938d7cc-0963-475b-a3df-3fa971f5a497-serving-cert\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.526480 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.526461    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0ada96f-0a98-4af7-b788-799c1c27bf8d-serving-cert\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.535542 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.535512    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9xw\" (UniqueName: \"kubernetes.io/projected/c0ada96f-0a98-4af7-b788-799c1c27bf8d-kube-api-access-6b9xw\") pod \"insights-operator-68d9dd94cf-pvc2q\" (UID: \"c0ada96f-0a98-4af7-b788-799c1c27bf8d\") " pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.536166 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.536126    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5hmr\" (UniqueName: \"kubernetes.io/projected/d938d7cc-0963-475b-a3df-3fa971f5a497-kube-api-access-v5hmr\") pod \"service-ca-operator-7695fc6c8c-9smvg\" (UID: \"d938d7cc-0963-475b-a3df-3fa971f5a497\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.536345 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.536326    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-865vr\" (UniqueName: \"kubernetes.io/projected/0b4ac720-3126-41d8-b87e-417cc38c9148-kube-api-access-865vr\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:32.538183 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.538156    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmg4h\" (UniqueName: \"kubernetes.io/projected/20967626-d110-4b59-9396-ddb0e8f3fa23-kube-api-access-hmg4h\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:32.541316 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.541295    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:32.553181 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.553165    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5"
Jul 10 16:40:32.560222 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.560203    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf"
Jul 10 16:40:32.566921 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.566898    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:32.630494 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.630455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:32.656023 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.655700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"
Jul 10 16:40:32.670100 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.670074    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q"
Jul 10 16:40:32.696390 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.696174    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5"]
Jul 10 16:40:32.699531 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:40:32.699498    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49d99475_2140_4169_84d3_27a7597390be.slice/crio-b7668f88ef232b0d6d21fbbf0ab8742b38820b625dc8669ef242242b65ce437b WatchSource:0}: Error finding container b7668f88ef232b0d6d21fbbf0ab8742b38820b625dc8669ef242242b65ce437b: Status 404 returned error can't find the container with id b7668f88ef232b0d6d21fbbf0ab8742b38820b625dc8669ef242242b65ce437b
Jul 10 16:40:32.714801 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.714755    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf"]
Jul 10 16:40:32.732703 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.732659    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-bbclc"]
Jul 10 16:40:32.737978 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:40:32.737658    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575c4bf2_e2ac_41e4_86c6_d5705cc47db6.slice/crio-ebdfe28d27e4042ec652a0d5a2b1fb2e32a81e22f38ec69f073bb24cfaea511e WatchSource:0}: Error finding container ebdfe28d27e4042ec652a0d5a2b1fb2e32a81e22f38ec69f073bb24cfaea511e: Status 404 returned error can't find the container with id ebdfe28d27e4042ec652a0d5a2b1fb2e32a81e22f38ec69f073bb24cfaea511e
Jul 10 16:40:32.803434 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.803407    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg"]
Jul 10 16:40:32.806347 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:40:32.806321    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd938d7cc_0963_475b_a3df_3fa971f5a497.slice/crio-08b4afb4893ef3f1f31865a8bec185b0ba633bd2e481c7820854e80b2665d57e WatchSource:0}: Error finding container 08b4afb4893ef3f1f31865a8bec185b0ba633bd2e481c7820854e80b2665d57e: Status 404 returned error can't find the container with id 08b4afb4893ef3f1f31865a8bec185b0ba633bd2e481c7820854e80b2665d57e
Jul 10 16:40:32.821806 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:32.821782    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pvc2q"]
Jul 10 16:40:32.824859 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:40:32.824837    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ada96f_0a98_4af7_b788_799c1c27bf8d.slice/crio-ad5ca3814edc491365e7ceb5b2950b912d613cfa0c0564661d10cfe940009844 WatchSource:0}: Error finding container ad5ca3814edc491365e7ceb5b2950b912d613cfa0c0564661d10cfe940009844: Status 404 returned error can't find the container with id ad5ca3814edc491365e7ceb5b2950b912d613cfa0c0564661d10cfe940009844
Jul 10 16:40:33.028012 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.027978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:33.028210 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.028033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:33.028210 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:33.028141    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 16:40:33.028210 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:33.028153    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:33.028210 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:33.028207    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls podName:0b4ac720-3126-41d8-b87e-417cc38c9148 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:34.02819019 +0000 UTC m=+254.628365822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gwqq" (UID: "0b4ac720-3126-41d8-b87e-417cc38c9148") : secret "samples-operator-tls" not found
Jul 10 16:40:33.028450 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:33.028223    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls podName:20967626-d110-4b59-9396-ddb0e8f3fa23 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:34.028216723 +0000 UTC m=+254.628392356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wwbqt" (UID: "20967626-d110-4b59-9396-ddb0e8f3fa23") : secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:33.567426 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.567347    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q" event={"ID":"c0ada96f-0a98-4af7-b788-799c1c27bf8d","Type":"ContainerStarted","Data":"ad5ca3814edc491365e7ceb5b2950b912d613cfa0c0564661d10cfe940009844"}
Jul 10 16:40:33.568778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.568728    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg" event={"ID":"d938d7cc-0963-475b-a3df-3fa971f5a497","Type":"ContainerStarted","Data":"08b4afb4893ef3f1f31865a8bec185b0ba633bd2e481c7820854e80b2665d57e"}
Jul 10 16:40:33.570555 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.570500    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf" event={"ID":"38ef6130-1742-4bc2-bf7e-dc0ac8463794","Type":"ContainerStarted","Data":"18fcf12687926b6821eab88b07078949973990cefcebec7eff866e1d2e9a204c"}
Jul 10 16:40:33.570660 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.570574    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf" event={"ID":"38ef6130-1742-4bc2-bf7e-dc0ac8463794","Type":"ContainerStarted","Data":"da99454a93b0395635938e2848e108f53da9741f6396351fda2e05dd06d20f86"}
Jul 10 16:40:33.571779 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.571756    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5" event={"ID":"49d99475-2140-4169-84d3-27a7597390be","Type":"ContainerStarted","Data":"b7668f88ef232b0d6d21fbbf0ab8742b38820b625dc8669ef242242b65ce437b"}
Jul 10 16:40:33.572872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.572847    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bbclc" event={"ID":"575c4bf2-e2ac-41e4-86c6-d5705cc47db6","Type":"ContainerStarted","Data":"ebdfe28d27e4042ec652a0d5a2b1fb2e32a81e22f38ec69f073bb24cfaea511e"}
Jul 10 16:40:33.587173 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:33.587118    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-lwqgf" podStartSLOduration=1.5870991700000001 podStartE2EDuration="1.58709917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:33.586966683 +0000 UTC m=+254.187142335" watchObservedRunningTime="2026-07-10 16:40:33.58709917 +0000 UTC m=+254.187274826"
Jul 10 16:40:34.037327 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:34.037285    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:34.037790 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:34.037359    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:34.037790 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:34.037495    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:34.037790 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:34.037559    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls podName:20967626-d110-4b59-9396-ddb0e8f3fa23 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:36.037540298 +0000 UTC m=+256.637715950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wwbqt" (UID: "20967626-d110-4b59-9396-ddb0e8f3fa23") : secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:34.038048 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:34.037990    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 16:40:34.038048 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:34.038043    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls podName:0b4ac720-3126-41d8-b87e-417cc38c9148 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:36.038026945 +0000 UTC m=+256.638202592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gwqq" (UID: "0b4ac720-3126-41d8-b87e-417cc38c9148") : secret "samples-operator-tls" not found
Jul 10 16:40:34.578976 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:34.578938    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5" event={"ID":"49d99475-2140-4169-84d3-27a7597390be","Type":"ContainerStarted","Data":"15db18911b88175c7c5954bb894f78081307a4d14604b4ce13aff39c7fb5a22e"}
Jul 10 16:40:34.596268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:34.596136    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fnjr5" podStartSLOduration=0.966602947 podStartE2EDuration="2.596113849s" totalImagesPullingTime="1.629510902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:34.595017528 +0000 UTC m=+255.195193186" watchObservedRunningTime="2026-07-10 16:40:34.596113849 +0000 UTC m=+255.196289506"
Jul 10 16:40:34.672745 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:34.672672    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:34.800981 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:34.800878    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:36.054587 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.054553    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:36.054966 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.054608    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:36.054966 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:36.054713    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 16:40:36.054966 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:36.054783    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls podName:0b4ac720-3126-41d8-b87e-417cc38c9148 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:40.054761115 +0000 UTC m=+260.654936751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gwqq" (UID: "0b4ac720-3126-41d8-b87e-417cc38c9148") : secret "samples-operator-tls" not found
Jul 10 16:40:36.054966 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:36.054715    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:36.054966 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:36.054840    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls podName:20967626-d110-4b59-9396-ddb0e8f3fa23 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:40.054828525 +0000 UTC m=+260.655004173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wwbqt" (UID: "20967626-d110-4b59-9396-ddb0e8f3fa23") : secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:36.587363 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.587331    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/0.log"
Jul 10 16:40:36.587540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.587383    2574 generic.go:356] "Generic (PLEG): container finished" podID="575c4bf2-e2ac-41e4-86c6-d5705cc47db6" containerID="4ba9861b6752290d77ef9ff847803113309c7cdb1ea0ca7a8638a124ed5de071" exitCode=255
Jul 10 16:40:36.587540 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.587477    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bbclc" event={"ID":"575c4bf2-e2ac-41e4-86c6-d5705cc47db6","Type":"ContainerDied","Data":"4ba9861b6752290d77ef9ff847803113309c7cdb1ea0ca7a8638a124ed5de071"}
Jul 10 16:40:36.587702 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.587675    2574 scope.go:117] "RemoveContainer" containerID="4ba9861b6752290d77ef9ff847803113309c7cdb1ea0ca7a8638a124ed5de071"
Jul 10 16:40:36.588987 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.588966    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q" event={"ID":"c0ada96f-0a98-4af7-b788-799c1c27bf8d","Type":"ContainerStarted","Data":"18584986f65b553952e0780f97cf977bdd356d223c63a271bdb2939a58dc586f"}
Jul 10 16:40:36.590309 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.590280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg" event={"ID":"d938d7cc-0963-475b-a3df-3fa971f5a497","Type":"ContainerStarted","Data":"19c8f9d4ddcfc73be891159d9eafd27c38460f475ed42ec192ae7133ad9c9603"}
Jul 10 16:40:36.621591 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.621541    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q" podStartSLOduration=1.3395143059999999 podStartE2EDuration="4.621524318s" totalImagesPullingTime="3.282010012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:36.621443274 +0000 UTC m=+257.221618930" watchObservedRunningTime="2026-07-10 16:40:36.621524318 +0000 UTC m=+257.221699973"
Jul 10 16:40:36.642186 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.642141    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg" podStartSLOduration=1.3369493239999999 podStartE2EDuration="4.642125722s" totalImagesPullingTime="3.305176398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:36.641346273 +0000 UTC m=+257.241521941" watchObservedRunningTime="2026-07-10 16:40:36.642125722 +0000 UTC m=+257.242301376"
Jul 10 16:40:36.955140 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.955108    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp"]
Jul 10 16:40:36.957127 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.957095    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:36.958112 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.958094    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp"
Jul 10 16:40:36.961432 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.961406    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pxwcb\""
Jul 10 16:40:36.961539 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.961463    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 10 16:40:36.961539 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.961470    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 10 16:40:36.969217 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:36.969193    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp"]
Jul 10 16:40:37.021366 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.021328    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:37.062992 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.062962    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dmvl\" (UniqueName: \"kubernetes.io/projected/a0e14a6d-220e-4750-948a-9595fab9b123-kube-api-access-6dmvl\") pod \"migrator-7f59b54f6c-xwlgp\" (UID: \"a0e14a6d-220e-4750-948a-9595fab9b123\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp"
Jul 10 16:40:37.121757 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.121725    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:37.164118 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.164082    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dmvl\" (UniqueName: \"kubernetes.io/projected/a0e14a6d-220e-4750-948a-9595fab9b123-kube-api-access-6dmvl\") pod \"migrator-7f59b54f6c-xwlgp\" (UID: \"a0e14a6d-220e-4750-948a-9595fab9b123\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp"
Jul 10 16:40:37.173260 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.173230    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dmvl\" (UniqueName: \"kubernetes.io/projected/a0e14a6d-220e-4750-948a-9595fab9b123-kube-api-access-6dmvl\") pod \"migrator-7f59b54f6c-xwlgp\" (UID: \"a0e14a6d-220e-4750-948a-9595fab9b123\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp"
Jul 10 16:40:37.267312 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.267220    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp"
Jul 10 16:40:37.396823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.396794    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp"]
Jul 10 16:40:37.400106 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:40:37.400076    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e14a6d_220e_4750_948a_9595fab9b123.slice/crio-6aa3b1b8f806e6d783072bfc9c0c7ef3924945f224972daf43ae9e93d461d5d4 WatchSource:0}: Error finding container 6aa3b1b8f806e6d783072bfc9c0c7ef3924945f224972daf43ae9e93d461d5d4: Status 404 returned error can't find the container with id 6aa3b1b8f806e6d783072bfc9c0c7ef3924945f224972daf43ae9e93d461d5d4
Jul 10 16:40:37.490545 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.490513    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l6vcp"]
Jul 10 16:40:37.495505 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.495481    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.498342 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.498316    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 16:40:37.498631 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.498613    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 16:40:37.498690 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.498666    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2jlt9\""
Jul 10 16:40:37.504769 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.504747    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6vcp"]
Jul 10 16:40:37.532459 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.532374    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:37.568069 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.568030    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.568069 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.568070    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a13da533-feef-4780-95e3-9c3b92b0682a-crio-socket\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.568331 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.568103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lndnp\" (UniqueName: \"kubernetes.io/projected/a13da533-feef-4780-95e3-9c3b92b0682a-kube-api-access-lndnp\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.568331 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.568151    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a13da533-feef-4780-95e3-9c3b92b0682a-data-volume\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.568331 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.568194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.593750 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.593713    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:37.594735 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.594710    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp" event={"ID":"a0e14a6d-220e-4750-948a-9595fab9b123","Type":"ContainerStarted","Data":"6aa3b1b8f806e6d783072bfc9c0c7ef3924945f224972daf43ae9e93d461d5d4"}
Jul 10 16:40:37.596269 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.596252    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:40:37.596642 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.596625    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/0.log"
Jul 10 16:40:37.596709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.596662    2574 generic.go:356] "Generic (PLEG): container finished" podID="575c4bf2-e2ac-41e4-86c6-d5705cc47db6" containerID="c5cc48117d30855ae2729c0760897c20f38ce27abf5ebf21a660f20912f98cab" exitCode=255
Jul 10 16:40:37.596709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.596688    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bbclc" event={"ID":"575c4bf2-e2ac-41e4-86c6-d5705cc47db6","Type":"ContainerDied","Data":"c5cc48117d30855ae2729c0760897c20f38ce27abf5ebf21a660f20912f98cab"}
Jul 10 16:40:37.596798 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.596748    2574 scope.go:117] "RemoveContainer" containerID="4ba9861b6752290d77ef9ff847803113309c7cdb1ea0ca7a8638a124ed5de071"
Jul 10 16:40:37.597037 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.597007    2574 scope.go:117] "RemoveContainer" containerID="c5cc48117d30855ae2729c0760897c20f38ce27abf5ebf21a660f20912f98cab"
Jul 10 16:40:37.597223 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:37.597202    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bbclc_openshift-console-operator(575c4bf2-e2ac-41e4-86c6-d5705cc47db6)\"" pod="openshift-console-operator/console-operator-7866497494-bbclc" podUID="575c4bf2-e2ac-41e4-86c6-d5705cc47db6"
Jul 10 16:40:37.669602 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.669561    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lndnp\" (UniqueName: \"kubernetes.io/projected/a13da533-feef-4780-95e3-9c3b92b0682a-kube-api-access-lndnp\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.669796 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.669619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a13da533-feef-4780-95e3-9c3b92b0682a-data-volume\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.669891 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.669863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.669999 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.669975    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a13da533-feef-4780-95e3-9c3b92b0682a-data-volume\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.670075 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:37.670048    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:37.670135 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:37.670129    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:38.170105647 +0000 UTC m=+258.770281292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:37.670232 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.670193    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.670293 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.670276    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a13da533-feef-4780-95e3-9c3b92b0682a-crio-socket\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.670394 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:37.670380    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 16:40:37.670846 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:37.670820    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:38.170592698 +0000 UTC m=+258.770768345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : configmap "kube-rbac-proxy" not found
Jul 10 16:40:37.670846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.670845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a13da533-feef-4780-95e3-9c3b92b0682a-crio-socket\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:37.680872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:37.680839    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lndnp\" (UniqueName: \"kubernetes.io/projected/a13da533-feef-4780-95e3-9c3b92b0682a-kube-api-access-lndnp\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:38.174220 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:38.174177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:38.174704 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:38.174274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:38.174704 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:38.174310    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 16:40:38.174704 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:38.174392    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:39.174366917 +0000 UTC m=+259.774542553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : configmap "kube-rbac-proxy" not found
Jul 10 16:40:38.174704 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:38.174449    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:38.174704 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:38.174518    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:39.174503169 +0000 UTC m=+259.774678801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:38.415922 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:38.415882    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:38.516827 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:38.516715    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:38.601050 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:38.601024    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:40:38.601383 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:38.601365    2574 scope.go:117] "RemoveContainer" containerID="c5cc48117d30855ae2729c0760897c20f38ce27abf5ebf21a660f20912f98cab"
Jul 10 16:40:38.601562 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:38.601541    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bbclc_openshift-console-operator(575c4bf2-e2ac-41e4-86c6-d5705cc47db6)\"" pod="openshift-console-operator/console-operator-7866497494-bbclc" podUID="575c4bf2-e2ac-41e4-86c6-d5705cc47db6"
Jul 10 16:40:38.663529 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:38.663498    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:38.721531 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:38.721482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:39.128837 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.128809    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:39.183459 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.183435    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:39.183749 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:39.183565    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 16:40:39.183749 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.183575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:39.183749 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:39.183632    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:41.18361205 +0000 UTC m=+261.783787698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : configmap "kube-rbac-proxy" not found
Jul 10 16:40:39.183749 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:39.183684    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:39.183749 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:39.183736    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:41.183720444 +0000 UTC m=+261.783896102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:39.229405 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.229376    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:39.606298 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.606265    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp" event={"ID":"a0e14a6d-220e-4750-948a-9595fab9b123","Type":"ContainerStarted","Data":"5881384c46d2dcd98691fd1c93c5aa497a5d941407a615d5a9ab07ade22fe859"}
Jul 10 16:40:39.606473 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.606315    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp" event={"ID":"a0e14a6d-220e-4750-948a-9595fab9b123","Type":"ContainerStarted","Data":"fb6029c6c7131b291354809c901395a68813f3347ccfc5f0094e457a3f8d990a"}
Jul 10 16:40:39.623040 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.622990    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xwlgp" podStartSLOduration=1.924795033 podStartE2EDuration="3.622974713s" totalImagesPullingTime="1.69817968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:39.622222149 +0000 UTC m=+260.222397822" watchObservedRunningTime="2026-07-10 16:40:39.622974713 +0000 UTC m=+260.223150367"
Jul 10 16:40:39.696900 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.696868    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:39.752444 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:39.752409    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:40.091427 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.091390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:40.091620 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.091496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:40.091620 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:40.091560    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:40.091620 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:40.091597    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 16:40:40.091782 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:40.091641    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls podName:20967626-d110-4b59-9396-ddb0e8f3fa23 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:48.09161989 +0000 UTC m=+268.691795522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wwbqt" (UID: "20967626-d110-4b59-9396-ddb0e8f3fa23") : secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:40.091782 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:40.091660    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls podName:0b4ac720-3126-41d8-b87e-417cc38c9148 nodeName:}" failed. No retries permitted until 2026-07-10 16:40:48.091650634 +0000 UTC m=+268.691826268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls") pod "cluster-samples-operator-65db858894-8gwqq" (UID: "0b4ac720-3126-41d8-b87e-417cc38c9148") : secret "samples-operator-tls" not found
Jul 10 16:40:40.281545 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.281518    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7f427_76c5f1d2-ca9e-44a3-9a36-aba1253886ee/dns-node-resolver/0.log"
Jul 10 16:40:40.723052 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.723013    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dc7kg"]
Jul 10 16:40:40.726116 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.726100    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.729170 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.729146    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 10 16:40:40.729269 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.729180    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 10 16:40:40.729269 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.729148    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 10 16:40:40.730604 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.730588    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5r2j9\""
Jul 10 16:40:40.730695 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.730620    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 10 16:40:40.733260 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.733242    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dc7kg"]
Jul 10 16:40:40.796840 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.796811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhm9z\" (UniqueName: \"kubernetes.io/projected/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-kube-api-access-lhm9z\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.796992 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.796962    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-signing-key\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.797038 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.796999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-signing-cabundle\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.867690 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.867653    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:40.897674 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.897646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-signing-key\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.897805 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.897689    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-signing-cabundle\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.897805 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.897754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhm9z\" (UniqueName: \"kubernetes.io/projected/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-kube-api-access-lhm9z\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.898414    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-signing-cabundle\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.900064 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.900039    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-signing-key\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.907129 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.907107    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhm9z\" (UniqueName: \"kubernetes.io/projected/2ec65a9b-e22e-4ef0-b54b-aabc870544ba-kube-api-access-lhm9z\") pod \"service-ca-79f68b9f4f-dc7kg\" (UID: \"2ec65a9b-e22e-4ef0-b54b-aabc870544ba\") " pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:40.968270 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:40.968236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:41.035961 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.035860    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg"
Jul 10 16:40:41.162012 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.161983    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-dc7kg"]
Jul 10 16:40:41.166114 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:40:41.166088    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec65a9b_e22e_4ef0_b54b_aabc870544ba.slice/crio-54d46e473d16470795883bc3a0a3d29ecb6146576ae0288f58a704361bf24cfc WatchSource:0}: Error finding container 54d46e473d16470795883bc3a0a3d29ecb6146576ae0288f58a704361bf24cfc: Status 404 returned error can't find the container with id 54d46e473d16470795883bc3a0a3d29ecb6146576ae0288f58a704361bf24cfc
Jul 10 16:40:41.201862 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.201835    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:41.201990 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.201971    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:41.202058 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:41.201971    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 16:40:41.202102 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:41.202049    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:41.202140 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:41.202106    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:45.202087243 +0000 UTC m=+265.802262880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : configmap "kube-rbac-proxy" not found
Jul 10 16:40:41.202180 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:41.202169    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:45.202145616 +0000 UTC m=+265.802321266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:41.481745 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.481719    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rbzv8_22f59fc7-5213-4c46-bb56-375112bb3e54/node-ca/0.log"
Jul 10 16:40:41.613900 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.613865    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg" event={"ID":"2ec65a9b-e22e-4ef0-b54b-aabc870544ba","Type":"ContainerStarted","Data":"df94caf21e55e676344518367a2e0364c60706357790f948904fc727b5058574"}
Jul 10 16:40:41.614080 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.613915    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg" event={"ID":"2ec65a9b-e22e-4ef0-b54b-aabc870544ba","Type":"ContainerStarted","Data":"54d46e473d16470795883bc3a0a3d29ecb6146576ae0288f58a704361bf24cfc"}
Jul 10 16:40:41.639126 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.639079    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-dc7kg" podStartSLOduration=1.639063916 podStartE2EDuration="1.639063916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:41.638420861 +0000 UTC m=+262.238596516" watchObservedRunningTime="2026-07-10 16:40:41.639063916 +0000 UTC m=+262.239239570"
Jul 10 16:40:41.928593 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:41.928557    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:42.282235 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.282199    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tjchb_8a552c5e-c995-4240-ad1d-fd4c0b548e02/serve-healthcheck-canary/0.log"
Jul 10 16:40:42.485709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.485675    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:42.486179 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.485989    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xwlgp_a0e14a6d-220e-4750-948a-9595fab9b123/migrator/0.log"
Jul 10 16:40:42.567662 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.567571    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:42.567920 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.567893    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:42.568113 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.568097    2574 scope.go:117] "RemoveContainer" containerID="c5cc48117d30855ae2729c0760897c20f38ce27abf5ebf21a660f20912f98cab"
Jul 10 16:40:42.568315 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:42.568284    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bbclc_openshift-console-operator(575c4bf2-e2ac-41e4-86c6-d5705cc47db6)\"" pod="openshift-console-operator/console-operator-7866497494-bbclc" podUID="575c4bf2-e2ac-41e4-86c6-d5705cc47db6"
Jul 10 16:40:42.618759 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.618727    2574 scope.go:117] "RemoveContainer" containerID="c5cc48117d30855ae2729c0760897c20f38ce27abf5ebf21a660f20912f98cab"
Jul 10 16:40:42.618959 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:42.618915    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-bbclc_openshift-console-operator(575c4bf2-e2ac-41e4-86c6-d5705cc47db6)\"" pod="openshift-console-operator/console-operator-7866497494-bbclc" podUID="575c4bf2-e2ac-41e4-86c6-d5705cc47db6"
Jul 10 16:40:42.683151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.683118    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xwlgp_a0e14a6d-220e-4750-948a-9595fab9b123/graceful-termination/0.log"
Jul 10 16:40:42.742781 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.742749    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:42.885040 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:42.884756    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:43.026059 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:43.026024    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:43.141779 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:43.141695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:43.239390 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:43.239355    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:43.564770 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:43.564740    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:44.371219 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:44.371192    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:44.788554 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:44.788526    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:44.964707 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:44.964678    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:45.173135 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:45.173101    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:45.241321 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:45.241288    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:45.241480 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:45.241364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:45.241480 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:45.241410    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 16:40:45.241480 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:45.241469    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:45.241480 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:45.241479    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:53.241461627 +0000 UTC m=+273.841637265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : configmap "kube-rbac-proxy" not found
Jul 10 16:40:45.241634 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:45.241503    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls podName:a13da533-feef-4780-95e3-9c3b92b0682a nodeName:}" failed. No retries permitted until 2026-07-10 16:40:53.241493536 +0000 UTC m=+273.841669171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6vcp" (UID: "a13da533-feef-4780-95e3-9c3b92b0682a") : secret "insights-runtime-extractor-tls" not found
Jul 10 16:40:45.369370 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:45.369334    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:45.570663 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:45.570566    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:46.307544 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:46.307510    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:46.407826 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:46.407794    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:46.568276 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:46.568202    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:46.968650 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:46.968616    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:47.166102 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:47.166066    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:47.361883 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:47.361800    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:47.761206 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:47.761177    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:48.159563 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:48.159534    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:48.165712 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:48.165685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:40:48.165857 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:48.165793    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:48.165857 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:48.165841    2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:48.165972 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:40:48.165897    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls podName:20967626-d110-4b59-9396-ddb0e8f3fa23 nodeName:}" failed. No retries permitted until 2026-07-10 16:41:04.165883122 +0000 UTC m=+284.766058756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-wwbqt" (UID: "20967626-d110-4b59-9396-ddb0e8f3fa23") : secret "cluster-monitoring-operator-tls" not found
Jul 10 16:40:48.168063 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:48.168043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b4ac720-3126-41d8-b87e-417cc38c9148-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-8gwqq\" (UID: \"0b4ac720-3126-41d8-b87e-417cc38c9148\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:48.264443 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:48.264411    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"
Jul 10 16:40:48.390127 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:48.390095    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq"]
Jul 10 16:40:48.637946 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:48.637901    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq" event={"ID":"0b4ac720-3126-41d8-b87e-417cc38c9148","Type":"ContainerStarted","Data":"17cdba662ea5f563af5027d03346b4d499991f48ca6c331d221d6b9966c90574"}
Jul 10 16:40:48.799391 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:48.799311    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:49.016052 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:49.016023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:49.157146 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:49.157048    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:49.358361 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:49.358317    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:49.763580 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:49.763543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:50.110337 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:50.110245    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:50.376886 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:50.376785    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:50.757315 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:50.757286    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:51.180347 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:51.180307    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:51.361424 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:51.361392    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:51.648842 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:51.648814    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq" event={"ID":"0b4ac720-3126-41d8-b87e-417cc38c9148","Type":"ContainerStarted","Data":"a5601fc48860abf7fcef10e1c69be96492355af3e1bc7d6b0b5cb75b24fd3cb2"}
Jul 10 16:40:51.649031 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:51.648887    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq" event={"ID":"0b4ac720-3126-41d8-b87e-417cc38c9148","Type":"ContainerStarted","Data":"5bd07c3457c7f9ecbd87342a61875e5283c6b4b54cbfd33803c525f052d38960"}
Jul 10 16:40:51.669578 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:51.669530    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-8gwqq" podStartSLOduration=17.408495004 podStartE2EDuration="19.669516439s" totalImagesPullingTime="2.261021435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:51.667976738 +0000 UTC m=+272.268152408" watchObservedRunningTime="2026-07-10 16:40:51.669516439 +0000 UTC m=+272.269692094"
Jul 10 16:40:51.763373 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:51.763341    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:52.374765 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:52.374732    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:52.760518 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:52.760485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:52.818678 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:52.818645    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:52.963086 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:52.963050    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:53.162642 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.162614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:53.308828 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.308779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:53.309010 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.308888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:53.309371 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.309351    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a13da533-feef-4780-95e3-9c3b92b0682a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:53.311111 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.311094    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a13da533-feef-4780-95e3-9c3b92b0682a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6vcp\" (UID: \"a13da533-feef-4780-95e3-9c3b92b0682a\") " pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:53.405764 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.405730    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6vcp"
Jul 10 16:40:53.548237 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.548203    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6vcp"]
Jul 10 16:40:53.551120 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:40:53.551087    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13da533_feef_4780_95e3_9c3b92b0682a.slice/crio-0cdc669d410597b937e92ff1a9d9b98b16726a765142ca61e181790c91c34c2a WatchSource:0}: Error finding container 0cdc669d410597b937e92ff1a9d9b98b16726a765142ca61e181790c91c34c2a: Status 404 returned error can't find the container with id 0cdc669d410597b937e92ff1a9d9b98b16726a765142ca61e181790c91c34c2a
Jul 10 16:40:53.657216 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.657182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6vcp" event={"ID":"a13da533-feef-4780-95e3-9c3b92b0682a","Type":"ContainerStarted","Data":"0cdc669d410597b937e92ff1a9d9b98b16726a765142ca61e181790c91c34c2a"}
Jul 10 16:40:53.861443 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:53.861360    2574 scope.go:117] "RemoveContainer" containerID="c5cc48117d30855ae2729c0760897c20f38ce27abf5ebf21a660f20912f98cab"
Jul 10 16:40:54.665491 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:54.665392    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:40:54.666354 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:54.665546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-bbclc" event={"ID":"575c4bf2-e2ac-41e4-86c6-d5705cc47db6","Type":"ContainerStarted","Data":"2b951efb583671a82f6f76f21037675b8815800a608bd58382e61a3ac573affc"}
Jul 10 16:40:54.666354 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:54.665980    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:54.676385 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:54.675910    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-bbclc"
Jul 10 16:40:54.684405 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:54.684030    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-bbclc" podStartSLOduration=19.317413184 podStartE2EDuration="22.684011863s" totalImagesPullingTime="3.366598679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:40:54.683132414 +0000 UTC m=+275.283308090" watchObservedRunningTime="2026-07-10 16:40:54.684011863 +0000 UTC m=+275.284187521"
Jul 10 16:40:54.830532 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:54.830494    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:54.932380 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:54.932294    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:55.032346 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:55.032308    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:55.132978 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:55.132941    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:55.510473 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:55.510437    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:55.575809 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:55.575768    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:55.714543 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:55.714508    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:55.816119 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:55.816026    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:55.915319 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:55.915285    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:56.139902 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:56.139800    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:56.191047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:56.191003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:56.351810 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:56.351761    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:56.521581 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:56.521549    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:57.046619 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:57.046584    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:57.408385 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:57.408352    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:57.511085 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:57.511060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:57.679068 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:57.678978    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6vcp" event={"ID":"a13da533-feef-4780-95e3-9c3b92b0682a","Type":"ContainerStarted","Data":"f9c70290c3349e635f7b864db26490d509b258a1a33dc00ee62f33eb4f037e80"}
Jul 10 16:40:58.133084 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:58.133055    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:58.182278 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:58.182251    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:58.345635 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:58.345550    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:58.396136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:58.396094    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:40:58.683985 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:58.683944    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6vcp" event={"ID":"a13da533-feef-4780-95e3-9c3b92b0682a","Type":"ContainerStarted","Data":"525f6043e996def2711cdb81c83b828ee030ab91b78f6709c389e81d8bfd92c3"}
Jul 10 16:40:59.946564 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:40:59.946533    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:00.048118 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:00.048060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:00.691695 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:00.691668    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6vcp" event={"ID":"a13da533-feef-4780-95e3-9c3b92b0682a","Type":"ContainerStarted","Data":"c9ac34f06559b822dc64eb09101f564bf9ffaca8a2d42798c67de618e50196e5"}
Jul 10 16:41:00.710069 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:00.710021    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l6vcp" podStartSLOduration=16.800621718 podStartE2EDuration="23.710005435s" totalImagesPullingTime="6.909383717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 16:40:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:00.709014298 +0000 UTC m=+281.309189950" watchObservedRunningTime="2026-07-10 16:41:00.710005435 +0000 UTC m=+281.310181090"
Jul 10 16:41:01.337557 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:01.337501    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr" podUID="c595dc1c-3846-4b2a-a102-eaa6f7f02a6b"
Jul 10 16:41:01.337557 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:01.337514    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j2fhq" podUID="91942a10-f7ff-4dcd-935a-b55f45182a1d"
Jul 10 16:41:01.337557 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:01.337514    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" podUID="ebfcdd4e-973e-42c7-b37b-010772cefa07"
Jul 10 16:41:01.695246 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:01.695218    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:41:01.695246 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:01.695234    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:41:01.695464 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:01.695218    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:41:04.202780 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:04.202726    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:41:04.205251 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:04.205226    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20967626-d110-4b59-9396-ddb0e8f3fa23-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-wwbqt\" (UID: \"20967626-d110-4b59-9396-ddb0e8f3fa23\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:41:04.447180 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:04.447143    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"
Jul 10 16:41:04.572866 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:04.572813    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt"]
Jul 10 16:41:04.576419 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:04.576390    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20967626_d110_4b59_9396_ddb0e8f3fa23.slice/crio-711731c8620b97ea0c650f752d73b1a72cf89302fa45e80eff51f6b4ebdcec98 WatchSource:0}: Error finding container 711731c8620b97ea0c650f752d73b1a72cf89302fa45e80eff51f6b4ebdcec98: Status 404 returned error can't find the container with id 711731c8620b97ea0c650f752d73b1a72cf89302fa45e80eff51f6b4ebdcec98
Jul 10 16:41:04.705533 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:04.705448    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt" event={"ID":"20967626-d110-4b59-9396-ddb0e8f3fa23","Type":"ContainerStarted","Data":"711731c8620b97ea0c650f752d73b1a72cf89302fa45e80eff51f6b4ebdcec98"}
Jul 10 16:41:05.016212 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.016181    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:05.079408 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.079376    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:05.212217 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.212179    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:41:05.212698 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.212244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:41:05.212698 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.212284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:41:05.214904 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.214873    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c595dc1c-3846-4b2a-a102-eaa6f7f02a6b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rwhkr\" (UID: \"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:41:05.215042 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.214873    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"image-registry-76df47bc4c-89j6t\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") " pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:41:05.215042 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.214919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/91942a10-f7ff-4dcd-935a-b55f45182a1d-metrics-tls\") pod \"dns-default-j2fhq\" (UID: \"91942a10-f7ff-4dcd-935a-b55f45182a1d\") " pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:41:05.300544 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.300471    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jqrx8\""
Jul 10 16:41:05.300544 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.300471    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kj2p2\""
Jul 10 16:41:05.300699 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.300485    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-csvlq\""
Jul 10 16:41:05.306055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.306034    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"
Jul 10 16:41:05.306120 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.306070    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:41:05.306120 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.306107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:41:05.470419 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.470199    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76df47bc4c-89j6t"]
Jul 10 16:41:05.472670 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:05.472643    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfcdd4e_973e_42c7_b37b_010772cefa07.slice/crio-55e269b4cb529a159479ed51fa5cc65149b363693e704c589ba33983c8f10865 WatchSource:0}: Error finding container 55e269b4cb529a159479ed51fa5cc65149b363693e704c589ba33983c8f10865: Status 404 returned error can't find the container with id 55e269b4cb529a159479ed51fa5cc65149b363693e704c589ba33983c8f10865
Jul 10 16:41:05.696166 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.696125    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j2fhq"]
Jul 10 16:41:05.699156 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.699089    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rwhkr"]
Jul 10 16:41:05.700102 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:05.700072    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91942a10_f7ff_4dcd_935a_b55f45182a1d.slice/crio-5e06f8b928db13bb08f34e3ce09c170684fb81f7b54cadf12a77567b2556add1 WatchSource:0}: Error finding container 5e06f8b928db13bb08f34e3ce09c170684fb81f7b54cadf12a77567b2556add1: Status 404 returned error can't find the container with id 5e06f8b928db13bb08f34e3ce09c170684fb81f7b54cadf12a77567b2556add1
Jul 10 16:41:05.702305 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:05.702202    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc595dc1c_3846_4b2a_a102_eaa6f7f02a6b.slice/crio-e664b8fd0cceaa818e67790a913d68bd47eaef292a9b68cf77ba944dc788cff2 WatchSource:0}: Error finding container e664b8fd0cceaa818e67790a913d68bd47eaef292a9b68cf77ba944dc788cff2: Status 404 returned error can't find the container with id e664b8fd0cceaa818e67790a913d68bd47eaef292a9b68cf77ba944dc788cff2
Jul 10 16:41:05.710419 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.710393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2fhq" event={"ID":"91942a10-f7ff-4dcd-935a-b55f45182a1d","Type":"ContainerStarted","Data":"5e06f8b928db13bb08f34e3ce09c170684fb81f7b54cadf12a77567b2556add1"}
Jul 10 16:41:05.711683 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.711655    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr" event={"ID":"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b","Type":"ContainerStarted","Data":"e664b8fd0cceaa818e67790a913d68bd47eaef292a9b68cf77ba944dc788cff2"}
Jul 10 16:41:05.713416 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.713390    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" event={"ID":"ebfcdd4e-973e-42c7-b37b-010772cefa07","Type":"ContainerStarted","Data":"345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5"}
Jul 10 16:41:05.713538 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.713437    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" event={"ID":"ebfcdd4e-973e-42c7-b37b-010772cefa07","Type":"ContainerStarted","Data":"55e269b4cb529a159479ed51fa5cc65149b363693e704c589ba33983c8f10865"}
Jul 10 16:41:05.713602 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.713547    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:41:05.735195 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:05.734906    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" podStartSLOduration=284.734882794 podStartE2EDuration="4m44.734882794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:05.733920354 +0000 UTC m=+286.334096021" watchObservedRunningTime="2026-07-10 16:41:05.734882794 +0000 UTC m=+286.335058445"
Jul 10 16:41:07.528389 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.528303    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:07.630430 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.630398    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:07.705127 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.705093    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:07.727522 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.727482    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr" event={"ID":"c595dc1c-3846-4b2a-a102-eaa6f7f02a6b","Type":"ContainerStarted","Data":"50a4f85c94580d5e7e195ce2aa1ca36b25170b530abf6b8b9054f02452375c00"}
Jul 10 16:41:07.729613 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.729585    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt" event={"ID":"20967626-d110-4b59-9396-ddb0e8f3fa23","Type":"ContainerStarted","Data":"3914d43846cc486746dd50a3336e030cd14a1fb22a2ad584365a163fb3170694"}
Jul 10 16:41:07.744691 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.744649    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-rwhkr" podStartSLOduration=271.275505633 podStartE2EDuration="4m32.744632684s" totalImagesPullingTime="1.469127051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:07.743942695 +0000 UTC m=+288.344118341" watchObservedRunningTime="2026-07-10 16:41:07.744632684 +0000 UTC m=+288.344808317"
Jul 10 16:41:07.760713 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.760663    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-wwbqt" podStartSLOduration=33.165402625 podStartE2EDuration="35.760643564s" totalImagesPullingTime="2.595240939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:07.759133853 +0000 UTC m=+288.359309508" watchObservedRunningTime="2026-07-10 16:41:07.760643564 +0000 UTC m=+288.360819221"
Jul 10 16:41:07.850728 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.850614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:07.915862 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:07.915827    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:08.735989 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:08.735959    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2fhq" event={"ID":"91942a10-f7ff-4dcd-935a-b55f45182a1d","Type":"ContainerStarted","Data":"2282c9f72f2ef13508424682870c188097ba3644612951702c978871f00126a0"}
Jul 10 16:41:09.741798 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:09.741759    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j2fhq" event={"ID":"91942a10-f7ff-4dcd-935a-b55f45182a1d","Type":"ContainerStarted","Data":"9bc064f54e8d40e5e4099124cd2f92c08dfe1350a601f2a79ac819b88b4879a6"}
Jul 10 16:41:09.742238 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:09.741870    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:41:09.761029 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:09.760982    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j2fhq" podStartSLOduration=251.884369063 podStartE2EDuration="4m14.7609685s" totalImagesPullingTime="2.876599437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:09.759085402 +0000 UTC m=+290.359261069" watchObservedRunningTime="2026-07-10 16:41:09.7609685 +0000 UTC m=+290.361144154"
Jul 10 16:41:10.724942 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.724906    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:10.757323 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.757296    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hfdrx"]
Jul 10 16:41:10.791392 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.791361    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hfdrx"]
Jul 10 16:41:10.791526 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.791466    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.794594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.794571    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 16:41:10.794737 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.794608    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 16:41:10.794737 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.794639    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 16:41:10.795965 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.795946    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hqd72\""
Jul 10 16:41:10.811849 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.811821    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:10.859590 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.859556    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.859727 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.859605    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bef26fbf-d627-4cc6-8781-d5dff34e5343-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.859727 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.859693    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxsqg\" (UniqueName: \"kubernetes.io/projected/bef26fbf-d627-4cc6-8781-d5dff34e5343-kube-api-access-zxsqg\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.859846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.859743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.960142 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.960102    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxsqg\" (UniqueName: \"kubernetes.io/projected/bef26fbf-d627-4cc6-8781-d5dff34e5343-kube-api-access-zxsqg\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.960339 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.960160    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.960339 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.960213    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.960339 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.960245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bef26fbf-d627-4cc6-8781-d5dff34e5343-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.960339 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:10.960310    2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 10 16:41:10.960552 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:10.960376    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-tls podName:bef26fbf-d627-4cc6-8781-d5dff34e5343 nodeName:}" failed. No retries permitted until 2026-07-10 16:41:11.460359551 +0000 UTC m=+292.060535185 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-tls") pod "prometheus-operator-64785b6675-hfdrx" (UID: "bef26fbf-d627-4cc6-8781-d5dff34e5343") : secret "prometheus-operator-tls" not found
Jul 10 16:41:10.960967 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.960945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bef26fbf-d627-4cc6-8781-d5dff34e5343-metrics-client-ca\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.962456 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.962437    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:10.971303 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:10.971282    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxsqg\" (UniqueName: \"kubernetes.io/projected/bef26fbf-d627-4cc6-8781-d5dff34e5343-kube-api-access-zxsqg\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:11.465275 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:11.465241    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:11.467619 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:11.467593    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bef26fbf-d627-4cc6-8781-d5dff34e5343-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-hfdrx\" (UID: \"bef26fbf-d627-4cc6-8781-d5dff34e5343\") " pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:11.490702 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:11.490669    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:11.701096 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:11.701059    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx"
Jul 10 16:41:11.741157 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:11.741075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:11.801077 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:11.801042    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:11.827677 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:11.827653    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-hfdrx"]
Jul 10 16:41:11.830214 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:11.830185    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef26fbf_d627_4cc6_8781_d5dff34e5343.slice/crio-5d6ab083d46e187250877693972f6017fdc183a5085c17567758948992d5fe31 WatchSource:0}: Error finding container 5d6ab083d46e187250877693972f6017fdc183a5085c17567758948992d5fe31: Status 404 returned error can't find the container with id 5d6ab083d46e187250877693972f6017fdc183a5085c17567758948992d5fe31
Jul 10 16:41:12.756661 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:12.756627    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx" event={"ID":"bef26fbf-d627-4cc6-8781-d5dff34e5343","Type":"ContainerStarted","Data":"5d6ab083d46e187250877693972f6017fdc183a5085c17567758948992d5fe31"}
Jul 10 16:41:12.943709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:12.943674    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:13.045100 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:13.045005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:13.762664 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:13.762635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx" event={"ID":"bef26fbf-d627-4cc6-8781-d5dff34e5343","Type":"ContainerStarted","Data":"2ea9facb89ac7c9f41935e4569ddb1cdf2472283406c2b1a1507b10ad7d03551"}
Jul 10 16:41:13.940150 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:13.940073    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:13.992260 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:13.992228    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:14.546911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:14.546881    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:14.603908 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:14.603876    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:14.767668 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:14.767634    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx" event={"ID":"bef26fbf-d627-4cc6-8781-d5dff34e5343","Type":"ContainerStarted","Data":"50eba97708de356f63425b48ab977dffea92d0b99ac4962e04c30713b80a9e7e"}
Jul 10 16:41:14.787568 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:14.787518    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-hfdrx" podStartSLOduration=2.961424991 podStartE2EDuration="4.787502963s" totalImagesPullingTime="1.826077972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:14.785178487 +0000 UTC m=+295.385354144" watchObservedRunningTime="2026-07-10 16:41:14.787502963 +0000 UTC m=+295.387678641"
Jul 10 16:41:16.846518 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:16.846487    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:16.862648 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:16.862615    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qlswx" podUID="6df769b8-14bb-4309-b135-f356e95f75e1"
Jul 10 16:41:17.076861 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.076826    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:17.106151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.106067    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bsznp"]
Jul 10 16:41:17.109439 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.109412    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.112117 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.112084    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 16:41:17.112518 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.112496    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5l4q2\""
Jul 10 16:41:17.112711 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.112693    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 16:41:17.113113 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.113093    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 16:41:17.163168 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.163134    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:17.210465 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210429    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.210465 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-sys\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.210708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1e31e00-cdfd-45b4-821a-f2523774fc87-metrics-client-ca\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.210708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b9qq\" (UniqueName: \"kubernetes.io/projected/c1e31e00-cdfd-45b4-821a-f2523774fc87-kube-api-access-8b9qq\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.210708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210594    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.210708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210629    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-root\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.210708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-tls\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.210973 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210733    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-textfile\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.210973 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.210760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-wtmp\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.244335 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.244302    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:17.311684 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311652    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-textfile\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.311684 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-wtmp\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.311947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.311947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-sys\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.311947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1e31e00-cdfd-45b4-821a-f2523774fc87-metrics-client-ca\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.311947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311802    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b9qq\" (UniqueName: \"kubernetes.io/projected/c1e31e00-cdfd-45b4-821a-f2523774fc87-kube-api-access-8b9qq\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.311947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.311947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311854    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-wtmp\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.311947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311911    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-sys\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.312283 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-root\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.312283 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.311982    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-tls\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.312283 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:17.312091    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 16:41:17.312283 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:17.312154    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-tls podName:c1e31e00-cdfd-45b4-821a-f2523774fc87 nodeName:}" failed. No retries permitted until 2026-07-10 16:41:17.812135586 +0000 UTC m=+298.412311221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-tls") pod "node-exporter-bsznp" (UID: "c1e31e00-cdfd-45b4-821a-f2523774fc87") : secret "node-exporter-tls" not found
Jul 10 16:41:17.312283 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.312211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1e31e00-cdfd-45b4-821a-f2523774fc87-root\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.312633 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.312610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-textfile\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.312751 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.312733    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1e31e00-cdfd-45b4-821a-f2523774fc87-metrics-client-ca\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.312818 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.312761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-accelerators-collector-config\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.314269 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.314249    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.325548 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.325518    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b9qq\" (UniqueName: \"kubernetes.io/projected/c1e31e00-cdfd-45b4-821a-f2523774fc87-kube-api-access-8b9qq\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.344451 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.344423    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:17.445036 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.445002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:17.545568 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.545535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:17.816952 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.816859    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-tls\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.819151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.819130    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1e31e00-cdfd-45b4-821a-f2523774fc87-node-exporter-tls\") pod \"node-exporter-bsznp\" (UID: \"c1e31e00-cdfd-45b4-821a-f2523774fc87\") " pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:17.843612 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:17.843585    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:18.027467 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.027436    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bsznp"
Jul 10 16:41:18.041274 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:18.041242    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e31e00_cdfd_45b4_821a_f2523774fc87.slice/crio-911b449376ef3a5d20d5537bb9757d686a0591fb7951cafbcfad0aad8172deab WatchSource:0}: Error finding container 911b449376ef3a5d20d5537bb9757d686a0591fb7951cafbcfad0aad8172deab: Status 404 returned error can't find the container with id 911b449376ef3a5d20d5537bb9757d686a0591fb7951cafbcfad0aad8172deab
Jul 10 16:41:18.078739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.078661    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:18.160344 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.160311    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:18.167377 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.167353    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 16:41:18.172124 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.172108    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.176467 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.176445    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 16:41:18.176971 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.176675    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 16:41:18.176971 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.176736    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 16:41:18.176971 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.176796    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 16:41:18.176971 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.176814    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 16:41:18.176971 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.176846    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 16:41:18.177211 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.177127    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-86x2l\""
Jul 10 16:41:18.177211 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.177145    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 16:41:18.177614 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.177596    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 16:41:18.177985 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.177970    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 16:41:18.224376 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.224348    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 16:41:18.320973 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.320923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321152 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.320981    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-out\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321152 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321152 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321067    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321152 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321152 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321152 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-volume\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321152 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321506 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321171    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321506 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321506 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-web-config\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321506 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321282    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w728r\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-kube-api-access-w728r\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.321506 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.321327    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.392813 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.392721    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:18.422700 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.422872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422706    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-out\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.422872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422757    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.422872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422789    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.422872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422819    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.422872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.422872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422869    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-volume\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.423363 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.423363 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.422980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.423363 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.423011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.423363 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.423084    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-web-config\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.423363 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.423114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w728r\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-kube-api-access-w728r\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.423363 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.423148    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.423363 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.423270    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.424198 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.423858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.424635 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.424606    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.425699 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.425675    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.426096 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.426059    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-web-config\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.426255 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.426233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-out\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.426576 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.426550    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.427135 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.427113    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.427472 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.427452    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-volume\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.427546 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.427455    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.427815 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.427795    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.427874 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.427805    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.432568 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.432550    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w728r\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-kube-api-access-w728r\") pod \"alertmanager-main-0\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.483517 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.483486    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:41:18.642667 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.642581    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 16:41:18.646551 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:18.646523    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380d9a21_c303_43c0_ac3c_ba45afe9a85f.slice/crio-15435fe3a3e29dcbf0d710658dc30639e9706c380423e1ad063e0be7577955c6 WatchSource:0}: Error finding container 15435fe3a3e29dcbf0d710658dc30639e9706c380423e1ad063e0be7577955c6: Status 404 returned error can't find the container with id 15435fe3a3e29dcbf0d710658dc30639e9706c380423e1ad063e0be7577955c6
Jul 10 16:41:18.783802 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.783761    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerStarted","Data":"15435fe3a3e29dcbf0d710658dc30639e9706c380423e1ad063e0be7577955c6"}
Jul 10 16:41:18.785080 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:18.785054    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsznp" event={"ID":"c1e31e00-cdfd-45b4-821a-f2523774fc87","Type":"ContainerStarted","Data":"911b449376ef3a5d20d5537bb9757d686a0591fb7951cafbcfad0aad8172deab"}
Jul 10 16:41:19.748089 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:19.748057    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j2fhq"
Jul 10 16:41:19.791842 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:19.791803    2574 generic.go:356] "Generic (PLEG): container finished" podID="c1e31e00-cdfd-45b4-821a-f2523774fc87" containerID="5e5c1e45abaed560846e3974d5c3b0424274f1a58c0a71e20f75f477e0ef8dab" exitCode=0
Jul 10 16:41:19.792105 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:19.791855    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsznp" event={"ID":"c1e31e00-cdfd-45b4-821a-f2523774fc87","Type":"ContainerDied","Data":"5e5c1e45abaed560846e3974d5c3b0424274f1a58c0a71e20f75f477e0ef8dab"}
Jul 10 16:41:19.967419 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:19.967391    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:41:19.968380 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:19.968354    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:41:19.976260 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:19.976131    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:41:19.976260 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:19.976199    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:41:19.991013 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:19.981340    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 16:41:20.005648 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.005441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:20.069670 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.069577    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:20.092860 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.092825    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6657868674-wz2bl"]
Jul 10 16:41:20.096992 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.096852    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.100156 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.099891    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 10 16:41:20.100156 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.099951    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 10 16:41:20.100156 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.100002    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 10 16:41:20.100156 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.099895    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-be4o3o9gh1ld0\""
Jul 10 16:41:20.100658 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.100282    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 10 16:41:20.100771 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.100756    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4ml7n\""
Jul 10 16:41:20.101019 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.100998    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 10 16:41:20.108857 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.108837    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6657868674-wz2bl"]
Jul 10 16:41:20.217628 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.217593    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:20.241213 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.241177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xncbd\" (UniqueName: \"kubernetes.io/projected/bc230930-738f-4f07-aeeb-08373626fbda-kube-api-access-xncbd\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.241385 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.241262    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.241385 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.241297    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-tls\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.241385 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.241328    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-grpc-tls\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.241563 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.241407    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.241563 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.241452    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.241563 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.241527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.241688 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.241560    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc230930-738f-4f07-aeeb-08373626fbda-metrics-client-ca\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.318816 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.318721    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:20.342237 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.342205    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.342404 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.342249    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-tls\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.342404 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.342270    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-grpc-tls\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.342527 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.342406    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.342527 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.342440    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.342527 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.342491    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.342676 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.342526    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc230930-738f-4f07-aeeb-08373626fbda-metrics-client-ca\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.342676 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.342569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xncbd\" (UniqueName: \"kubernetes.io/projected/bc230930-738f-4f07-aeeb-08373626fbda-kube-api-access-xncbd\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.343642 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.343518    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc230930-738f-4f07-aeeb-08373626fbda-metrics-client-ca\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.345362 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.345325    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.345362 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.345334    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-tls\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.345538 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.345482    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-grpc-tls\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.345994 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.345968    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.346227 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.346204    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.346268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.346215    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bc230930-738f-4f07-aeeb-08373626fbda-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.353034 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.353014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xncbd\" (UniqueName: \"kubernetes.io/projected/bc230930-738f-4f07-aeeb-08373626fbda-kube-api-access-xncbd\") pod \"thanos-querier-6657868674-wz2bl\" (UID: \"bc230930-738f-4f07-aeeb-08373626fbda\") " pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.418652 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.418609    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:20.442283 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.442259    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:20.583033 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.582958    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6657868674-wz2bl"]
Jul 10 16:41:20.585639 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:20.585607    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc230930_738f_4f07_aeeb_08373626fbda.slice/crio-055dae76ee1a80a7d1276f457c31672f97e6ed6b61ee6165b164acc86f321bb0 WatchSource:0}: Error finding container 055dae76ee1a80a7d1276f457c31672f97e6ed6b61ee6165b164acc86f321bb0: Status 404 returned error can't find the container with id 055dae76ee1a80a7d1276f457c31672f97e6ed6b61ee6165b164acc86f321bb0
Jul 10 16:41:20.681377 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.681341    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:20.797565 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.797524    2574 generic.go:356] "Generic (PLEG): container finished" podID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerID="a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3" exitCode=0
Jul 10 16:41:20.798037 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.797561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerDied","Data":"a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3"}
Jul 10 16:41:20.799969 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.799921    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsznp" event={"ID":"c1e31e00-cdfd-45b4-821a-f2523774fc87","Type":"ContainerStarted","Data":"c2c9aa60d7635ef62c6fbe7f26ec2d998348e375f416c7eb89aa1adad8ce1e0b"}
Jul 10 16:41:20.800071 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.799998    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bsznp" event={"ID":"c1e31e00-cdfd-45b4-821a-f2523774fc87","Type":"ContainerStarted","Data":"b514ab812f7bc0fbdbb08de6f936e42d624e7ab43903947a6ba9e53a0443fc6e"}
Jul 10 16:41:20.801196 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.801164    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl" event={"ID":"bc230930-738f-4f07-aeeb-08373626fbda","Type":"ContainerStarted","Data":"055dae76ee1a80a7d1276f457c31672f97e6ed6b61ee6165b164acc86f321bb0"}
Jul 10 16:41:20.841467 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:20.841372    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bsznp" podStartSLOduration=2.771522957 podStartE2EDuration="3.841356258s" totalImagesPullingTime="1.006864664s" totalInitContainerRuntime="62.968637ms" isStatefulPod=true podCreationTimestamp="2026-07-10 16:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:20.839758063 +0000 UTC m=+301.439933718" watchObservedRunningTime="2026-07-10 16:41:20.841356258 +0000 UTC m=+301.441531912"
Jul 10 16:41:21.888472 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.888438    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"]
Jul 10 16:41:21.894258 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.894228    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:21.895413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.895375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:21.897990 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.897967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ggq2b\""
Jul 10 16:41:21.897990 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.897981    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 10 16:41:21.909555 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.909529    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"]
Jul 10 16:41:21.957996 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.957957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e703edd8-5444-4a89-a4c6-1c8f3700d00e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5v8k9\" (UID: \"e703edd8-5444-4a89-a4c6-1c8f3700d00e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:21.958176 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.958102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsb27\" (UniqueName: \"kubernetes.io/projected/e703edd8-5444-4a89-a4c6-1c8f3700d00e-kube-api-access-fsb27\") pod \"monitoring-plugin-5f68df7f58-5v8k9\" (UID: \"e703edd8-5444-4a89-a4c6-1c8f3700d00e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:21.992972 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:21.992923    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:22.059015 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.058962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e703edd8-5444-4a89-a4c6-1c8f3700d00e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5v8k9\" (UID: \"e703edd8-5444-4a89-a4c6-1c8f3700d00e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:22.059197 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.059076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsb27\" (UniqueName: \"kubernetes.io/projected/e703edd8-5444-4a89-a4c6-1c8f3700d00e-kube-api-access-fsb27\") pod \"monitoring-plugin-5f68df7f58-5v8k9\" (UID: \"e703edd8-5444-4a89-a4c6-1c8f3700d00e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:22.059197 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:22.059125    2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 10 16:41:22.059197 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:22.059195    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e703edd8-5444-4a89-a4c6-1c8f3700d00e-monitoring-plugin-cert podName:e703edd8-5444-4a89-a4c6-1c8f3700d00e nodeName:}" failed. No retries permitted until 2026-07-10 16:41:22.559174964 +0000 UTC m=+303.159350599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e703edd8-5444-4a89-a4c6-1c8f3700d00e-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-5v8k9" (UID: "e703edd8-5444-4a89-a4c6-1c8f3700d00e") : secret "monitoring-plugin-cert" not found
Jul 10 16:41:22.069514 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.069480    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsb27\" (UniqueName: \"kubernetes.io/projected/e703edd8-5444-4a89-a4c6-1c8f3700d00e-kube-api-access-fsb27\") pod \"monitoring-plugin-5f68df7f58-5v8k9\" (UID: \"e703edd8-5444-4a89-a4c6-1c8f3700d00e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:22.179783 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.179748    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76df47bc4c-89j6t"]
Jul 10 16:41:22.186416 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.186380    2574 patch_prober.go:28] interesting pod/image-registry-76df47bc4c-89j6t container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 16:41:22.186576 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.186439    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" podUID="ebfcdd4e-973e-42c7-b37b-010772cefa07" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 16:41:22.279286 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.277658    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:22.338606 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.338569    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57cd54d986-r24tl"]
Jul 10 16:41:22.342770 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.342750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.346080 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.346054    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 10 16:41:22.346080 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.346079    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 10 16:41:22.346296 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.346090    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 10 16:41:22.346296 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.346146    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-h8bv8\""
Jul 10 16:41:22.346296 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.346252    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 10 16:41:22.346492 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.346466    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 10 16:41:22.351675 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.351644    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 10 16:41:22.355279 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.355161    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57cd54d986-r24tl"]
Jul 10 16:41:22.357616 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.357582    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:22.423378 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.423341    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:22.463453 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.463362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-telemeter-client-tls\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.463453 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.463406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.463453 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.463444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-metrics-client-ca\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.463709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.463489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-secret-telemeter-client\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.463709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.463518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.463709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.463540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-federate-client-tls\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.463709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.463561    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-serving-certs-ca-bundle\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.463709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.463623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjjs\" (UniqueName: \"kubernetes.io/projected/5931e130-ee92-4763-9982-525554d0a042-kube-api-access-zdjjs\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.564652 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.564614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-metrics-client-ca\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.564652 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.564663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-secret-telemeter-client\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.564911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.564704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.564911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.564732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-federate-client-tls\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.564911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.564761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-serving-certs-ca-bundle\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.564911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.564832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjjs\" (UniqueName: \"kubernetes.io/projected/5931e130-ee92-4763-9982-525554d0a042-kube-api-access-zdjjs\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.564911 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.564881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e703edd8-5444-4a89-a4c6-1c8f3700d00e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5v8k9\" (UID: \"e703edd8-5444-4a89-a4c6-1c8f3700d00e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:22.565171 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.564976    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-telemeter-client-tls\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.565171 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.565010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.565670 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.565567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-metrics-client-ca\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.565777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.565706    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-serving-certs-ca-bundle\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.566432 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.566296    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5931e130-ee92-4763-9982-525554d0a042-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.568010 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.567985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-secret-telemeter-client\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.568010 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.567997    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e703edd8-5444-4a89-a4c6-1c8f3700d00e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5v8k9\" (UID: \"e703edd8-5444-4a89-a4c6-1c8f3700d00e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:22.568409 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.568219    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.568409 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.568307    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-federate-client-tls\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.568659 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.568640    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5931e130-ee92-4763-9982-525554d0a042-telemeter-client-tls\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.576335 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.576314    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjjs\" (UniqueName: \"kubernetes.io/projected/5931e130-ee92-4763-9982-525554d0a042-kube-api-access-zdjjs\") pod \"telemeter-client-57cd54d986-r24tl\" (UID: \"5931e130-ee92-4763-9982-525554d0a042\") " pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.654874 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.654841    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl"
Jul 10 16:41:22.665706 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.665658    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:22.806907 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:22.806830    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:23.273432 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.272161    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:41:23.288209 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.287244    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.297726 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.295547    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qcjnt\""
Jul 10 16:41:23.297726 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.295584    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 16:41:23.297726 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.295818    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 16:41:23.297726 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.295859    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 16:41:23.317233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.300962    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 16:41:23.317233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.301232    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 16:41:23.317233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.301534    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 16:41:23.317233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.301799    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-112lvidamruv3\""
Jul 10 16:41:23.317233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.302063    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 16:41:23.317233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.302289    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 16:41:23.317233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.302491    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 16:41:23.317233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.303995    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 16:41:23.322025 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.319886    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:41:23.322025 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.320084    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 16:41:23.330044 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.322089    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 16:41:23.331733 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.324870    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 16:41:23.333847 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.332221    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 16:41:23.335905 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.335885    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 16:41:23.373751 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373487    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.373751 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373629    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.373751 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373664    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.373751 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373694    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.373751 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373778    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373806    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373896    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.373998    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.374026    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdzzg\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-kube-api-access-qdzzg\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.374053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.374084    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.374136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.374115    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.375013 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.374184    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.375013 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.374241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.375013 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.374293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.375013 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.374354    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.433859 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.433781    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"]
Jul 10 16:41:23.444972 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:23.444904    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode703edd8_5444_4a89_a4c6_1c8f3700d00e.slice/crio-0e7e890f74a88e0c6fb731c3e7e112dfe9fef08f666ee379909b475ce9a0020b WatchSource:0}: Error finding container 0e7e890f74a88e0c6fb731c3e7e112dfe9fef08f666ee379909b475ce9a0020b: Status 404 returned error can't find the container with id 0e7e890f74a88e0c6fb731c3e7e112dfe9fef08f666ee379909b475ce9a0020b
Jul 10 16:41:23.447369 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.447294    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 16:41:23.461591 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.461569    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57cd54d986-r24tl"]
Jul 10 16:41:23.475114 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475071    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.475235 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475113    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.475235 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475147    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.475235 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475181    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.475235 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdzzg\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-kube-api-access-qdzzg\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475820    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475961    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.475975    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476056    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476104    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476180    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476214    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476259    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476287    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.476618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.476309    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.477571 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.477069    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.477629 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.477596    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.479310 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.478778    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.479310 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.479259    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.479476 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.479417    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.479476 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.479433    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.480980 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.480958    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.482274 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.481605    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.482274 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.481687    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.482274 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.482187    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.482483 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.482365    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.482643 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.482575    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.484117 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.483819    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.484117 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.484066    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.484242 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.484180    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.484983 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.484921    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.485754 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.485732    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.490323 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.490299    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdzzg\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-kube-api-access-qdzzg\") pod \"prometheus-k8s-0\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.662437 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.662381    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:23.817484 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.817460    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:41:23.819268 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:41:23.819241    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee3bacf_6267_4ca0_b37d_2ae1bb03ab0d.slice/crio-14fba204322b1cc71327152b0b106dd311a95c5951e6941db4e6303cc73f9738 WatchSource:0}: Error finding container 14fba204322b1cc71327152b0b106dd311a95c5951e6941db4e6303cc73f9738: Status 404 returned error can't find the container with id 14fba204322b1cc71327152b0b106dd311a95c5951e6941db4e6303cc73f9738
Jul 10 16:41:23.819895 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.819871    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerStarted","Data":"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe"}
Jul 10 16:41:23.820013 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.819960    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerStarted","Data":"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7"}
Jul 10 16:41:23.820013 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.819992    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerStarted","Data":"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836"}
Jul 10 16:41:23.820082 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.820022    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerStarted","Data":"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1"}
Jul 10 16:41:23.820082 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.820046    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerStarted","Data":"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719"}
Jul 10 16:41:23.822106 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.822083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl" event={"ID":"bc230930-738f-4f07-aeeb-08373626fbda","Type":"ContainerStarted","Data":"d2471323cddb0a3070d4b6ffef59b53d3fb09ce4ea067eb7313f5a525d310ec9"}
Jul 10 16:41:23.822191 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.822145    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl" event={"ID":"bc230930-738f-4f07-aeeb-08373626fbda","Type":"ContainerStarted","Data":"9dca7abc33fc2f68d388342d566b033f77fcd21e392f73c87e65fac1e3c8464b"}
Jul 10 16:41:23.822191 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.822183    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl" event={"ID":"bc230930-738f-4f07-aeeb-08373626fbda","Type":"ContainerStarted","Data":"dd45f59b9a9b80e7bf8e3b00f131d60d3328b64519e8bf1f28d77bcab7736f2c"}
Jul 10 16:41:23.823322 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.823292    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9" event={"ID":"e703edd8-5444-4a89-a4c6-1c8f3700d00e","Type":"ContainerStarted","Data":"0e7e890f74a88e0c6fb731c3e7e112dfe9fef08f666ee379909b475ce9a0020b"}
Jul 10 16:41:23.824373 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.824351    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl" event={"ID":"5931e130-ee92-4763-9982-525554d0a042","Type":"ContainerStarted","Data":"a26d63d8a30646c6e803d9cff86292951f9d89a883540682b011c6c1d0811131"}
Jul 10 16:41:23.945034 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:23.945002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:24.365297 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.365271    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:24.465777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.465750    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:24.833725 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.833670    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerStarted","Data":"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6"}
Jul 10 16:41:24.836880 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.836847    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl" event={"ID":"bc230930-738f-4f07-aeeb-08373626fbda","Type":"ContainerStarted","Data":"6c2919dfab27532697816d95fdf4c22c64912f221e541c10b67f641abc6b2bee"}
Jul 10 16:41:24.837022 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.836924    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl" event={"ID":"bc230930-738f-4f07-aeeb-08373626fbda","Type":"ContainerStarted","Data":"95123d103c451e5b94b88e50ec1a4a0dba5242ca624e543a544e3d4758dc2e94"}
Jul 10 16:41:24.837022 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.836983    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl" event={"ID":"bc230930-738f-4f07-aeeb-08373626fbda","Type":"ContainerStarted","Data":"8e9f86e376e1da15ad70860a7fdb98fff3d95a807be43774b588bff7c35a8286"}
Jul 10 16:41:24.837186 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.837025    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:24.838475 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.838444    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerID="13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4" exitCode=0
Jul 10 16:41:24.838592 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.838515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerDied","Data":"13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4"}
Jul 10 16:41:24.838592 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.838583    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerStarted","Data":"14fba204322b1cc71327152b0b106dd311a95c5951e6941db4e6303cc73f9738"}
Jul 10 16:41:24.862963 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.862855    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.435037945 podStartE2EDuration="6.862840963s" totalImagesPullingTime="4.406712255s" totalInitContainerRuntime="21.090763ms" isStatefulPod=false podCreationTimestamp="2026-07-10 16:41:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:24.860993433 +0000 UTC m=+305.461169087" watchObservedRunningTime="2026-07-10 16:41:24.862840963 +0000 UTC m=+305.463016617"
Jul 10 16:41:24.885120 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:24.885058    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl" podStartSLOduration=1.449076565 podStartE2EDuration="4.885040107s" totalImagesPullingTime="3.435963542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:41:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:24.884717745 +0000 UTC m=+305.484893469" watchObservedRunningTime="2026-07-10 16:41:24.885040107 +0000 UTC m=+305.485215766"
Jul 10 16:41:25.844337 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:25.844287    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9" event={"ID":"e703edd8-5444-4a89-a4c6-1c8f3700d00e","Type":"ContainerStarted","Data":"31b3f9006d131486a9e4a2c0033d267df96104f65abfa19213c3af4aec8fa897"}
Jul 10 16:41:25.844801 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:25.844401    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:25.851090 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:25.851064    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9"
Jul 10 16:41:25.861968 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:25.861883    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5v8k9" podStartSLOduration=3.140129683 podStartE2EDuration="4.861865661s" totalImagesPullingTime="1.721735978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:25.860076426 +0000 UTC m=+306.460252110" watchObservedRunningTime="2026-07-10 16:41:25.861865661 +0000 UTC m=+306.462041318"
Jul 10 16:41:26.851502 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:26.851459    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl" event={"ID":"5931e130-ee92-4763-9982-525554d0a042","Type":"ContainerStarted","Data":"d0a5a823a5c985102eed117a9eb4edf88758ae85e85ea17f61a5474e1bc07ef8"}
Jul 10 16:41:26.851999 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:26.851571    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl" event={"ID":"5931e130-ee92-4763-9982-525554d0a042","Type":"ContainerStarted","Data":"3777c5bccb6143e3acbffc87716ddfd95d005b1ce012752e2dbd2cc83da3e20a"}
Jul 10 16:41:26.851999 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:26.851603    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl" event={"ID":"5931e130-ee92-4763-9982-525554d0a042","Type":"ContainerStarted","Data":"a0e76f6ab1dcd30be788dd334051dc4fcb60c6e0efc31ad0143753850109c94f"}
Jul 10 16:41:26.877596 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:26.877546    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57cd54d986-r24tl" podStartSLOduration=2.330286212 podStartE2EDuration="4.877529371s" totalImagesPullingTime="2.547243159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:26.875609764 +0000 UTC m=+307.475785443" watchObservedRunningTime="2026-07-10 16:41:26.877529371 +0000 UTC m=+307.477705025"
Jul 10 16:41:27.919022 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:27.918985    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:28.019054 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:28.019014    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:28.469606 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:28.469552    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:28.522541 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:28.522452    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:28.861068 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:28.860994    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:41:28.868156 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:28.868129    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:29.269320 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:29.269286    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:29.873263 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:29.873175    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerStarted","Data":"7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe"}
Jul 10 16:41:29.873402 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:29.873262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerStarted","Data":"a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38"}
Jul 10 16:41:29.873402 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:29.873301    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerStarted","Data":"a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de"}
Jul 10 16:41:29.873402 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:29.873344    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerStarted","Data":"3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb"}
Jul 10 16:41:29.873402 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:29.873381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerStarted","Data":"9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45"}
Jul 10 16:41:29.873533 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:29.873419    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerStarted","Data":"c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89"}
Jul 10 16:41:29.904754 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:29.904708    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.538781055 podStartE2EDuration="6.904691322s" totalImagesPullingTime="4.347889385s" totalInitContainerRuntime="18.020882ms" isStatefulPod=false podCreationTimestamp="2026-07-10 16:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:41:29.90162652 +0000 UTC m=+310.501802193" watchObservedRunningTime="2026-07-10 16:41:29.904691322 +0000 UTC m=+310.504867009"
Jul 10 16:41:30.852184 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:30.852156    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6657868674-wz2bl"
Jul 10 16:41:32.185052 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:32.185019    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:41:33.663226 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:33.663192    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:41:34.065730 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:34.065642    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:34.121871 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:34.121840    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:36.117353 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:36.117312    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:36.174016 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:36.173982    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:37.167307 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:37.167271    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:37.269393 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:37.269360    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:38.429225 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:38.429198    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:38.531075 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:38.531040    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:38.631431 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:38.631395    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:42.411705 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:42.411669    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:42.512182 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:42.512141    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:43.140488 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:43.140442    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:43.239534 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:43.239500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:47.208373 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.208318    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" podUID="ebfcdd4e-973e-42c7-b37b-010772cefa07" containerName="registry" containerID="cri-o://345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5" gracePeriod=30
Jul 10 16:41:47.471696 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.471632    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:41:47.506940 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.506895    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") pod \"ebfcdd4e-973e-42c7-b37b-010772cefa07\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") "
Jul 10 16:41:47.507145 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.506971    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-image-registry-private-configuration\") pod \"ebfcdd4e-973e-42c7-b37b-010772cefa07\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") "
Jul 10 16:41:47.507145 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.507005    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-bound-sa-token\") pod \"ebfcdd4e-973e-42c7-b37b-010772cefa07\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") "
Jul 10 16:41:47.507145 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.507037    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkk9v\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-kube-api-access-wkk9v\") pod \"ebfcdd4e-973e-42c7-b37b-010772cefa07\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") "
Jul 10 16:41:47.507145 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.507069    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-installation-pull-secrets\") pod \"ebfcdd4e-973e-42c7-b37b-010772cefa07\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") "
Jul 10 16:41:47.507145 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.507094    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebfcdd4e-973e-42c7-b37b-010772cefa07-ca-trust-extracted\") pod \"ebfcdd4e-973e-42c7-b37b-010772cefa07\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") "
Jul 10 16:41:47.507145 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.507123    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-trusted-ca\") pod \"ebfcdd4e-973e-42c7-b37b-010772cefa07\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") "
Jul 10 16:41:47.507455 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.507156    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-certificates\") pod \"ebfcdd4e-973e-42c7-b37b-010772cefa07\" (UID: \"ebfcdd4e-973e-42c7-b37b-010772cefa07\") "
Jul 10 16:41:47.507727 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.507599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ebfcdd4e-973e-42c7-b37b-010772cefa07" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:41:47.507856 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.507796    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ebfcdd4e-973e-42c7-b37b-010772cefa07" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:41:47.510028 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.509988    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ebfcdd4e-973e-42c7-b37b-010772cefa07" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:41:47.510253 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.510226    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-kube-api-access-wkk9v" (OuterVolumeSpecName: "kube-api-access-wkk9v") pod "ebfcdd4e-973e-42c7-b37b-010772cefa07" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07"). InnerVolumeSpecName "kube-api-access-wkk9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:41:47.510346 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.510335    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ebfcdd4e-973e-42c7-b37b-010772cefa07" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:41:47.510750 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.510720    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ebfcdd4e-973e-42c7-b37b-010772cefa07" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:41:47.510845 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.510810    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ebfcdd4e-973e-42c7-b37b-010772cefa07" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:41:47.516150 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.516122    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebfcdd4e-973e-42c7-b37b-010772cefa07-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ebfcdd4e-973e-42c7-b37b-010772cefa07" (UID: "ebfcdd4e-973e-42c7-b37b-010772cefa07"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 16:41:47.608192 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.608158    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-image-registry-private-configuration\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:41:47.608192 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.608187    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-bound-sa-token\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:41:47.608192 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.608198    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkk9v\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-kube-api-access-wkk9v\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:41:47.608414 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.608207    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ebfcdd4e-973e-42c7-b37b-010772cefa07-installation-pull-secrets\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:41:47.608414 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.608216    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ebfcdd4e-973e-42c7-b37b-010772cefa07-ca-trust-extracted\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:41:47.608414 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.608224    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-trusted-ca\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:41:47.608414 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.608232    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-certificates\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:41:47.608414 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.608240    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ebfcdd4e-973e-42c7-b37b-010772cefa07-registry-tls\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:41:47.950919 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.950887    2574 generic.go:356] "Generic (PLEG): container finished" podID="ebfcdd4e-973e-42c7-b37b-010772cefa07" containerID="345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5" exitCode=0
Jul 10 16:41:47.951084 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.950947    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" event={"ID":"ebfcdd4e-973e-42c7-b37b-010772cefa07","Type":"ContainerDied","Data":"345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5"}
Jul 10 16:41:47.951084 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.950984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t" event={"ID":"ebfcdd4e-973e-42c7-b37b-010772cefa07","Type":"ContainerDied","Data":"55e269b4cb529a159479ed51fa5cc65149b363693e704c589ba33983c8f10865"}
Jul 10 16:41:47.951084 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.951003    2574 scope.go:117] "RemoveContainer" containerID="345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5"
Jul 10 16:41:47.951084 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.950947    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76df47bc4c-89j6t"
Jul 10 16:41:47.959687 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.959666    2574 scope.go:117] "RemoveContainer" containerID="345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5"
Jul 10 16:41:47.959965 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:41:47.959944    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5\": container with ID starting with 345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5 not found: ID does not exist" containerID="345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5"
Jul 10 16:41:47.960033 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.959980    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5"} err="failed to get container status \"345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5\": rpc error: code = NotFound desc = could not find container \"345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5\": container with ID starting with 345dbbb828409cd18346d31484c7a9e61ea368d674f0ddf51c71d8845227acd5 not found: ID does not exist"
Jul 10 16:41:47.969426 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.969403    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76df47bc4c-89j6t"]
Jul 10 16:41:47.975053 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:47.975030    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76df47bc4c-89j6t"]
Jul 10 16:41:49.491224 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:49.491178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:49.867364 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:49.867275    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebfcdd4e-973e-42c7-b37b-010772cefa07" path="/var/lib/kubelet/pods/ebfcdd4e-973e-42c7-b37b-010772cefa07/volumes"
Jul 10 16:41:52.976551 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:52.976514    2574 generic.go:356] "Generic (PLEG): container finished" podID="d938d7cc-0963-475b-a3df-3fa971f5a497" containerID="19c8f9d4ddcfc73be891159d9eafd27c38460f475ed42ec192ae7133ad9c9603" exitCode=0
Jul 10 16:41:52.977169 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:52.976591    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg" event={"ID":"d938d7cc-0963-475b-a3df-3fa971f5a497","Type":"ContainerDied","Data":"19c8f9d4ddcfc73be891159d9eafd27c38460f475ed42ec192ae7133ad9c9603"}
Jul 10 16:41:52.977169 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:52.977030    2574 scope.go:117] "RemoveContainer" containerID="19c8f9d4ddcfc73be891159d9eafd27c38460f475ed42ec192ae7133ad9c9603"
Jul 10 16:41:53.982688 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:53.982649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-9smvg" event={"ID":"d938d7cc-0963-475b-a3df-3fa971f5a497","Type":"ContainerStarted","Data":"9ac90e47be5928e1c33a9c8dce329f46806e678d34f0e1f029d4ffc501cdbbd9"}
Jul 10 16:41:57.403259 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:57.403221    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:41:57.467457 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:41:57.467427    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:00.164089 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:00.164055    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:00.218491 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:00.218447    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:07.712110 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:07.712071    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:07.767808 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:07.767777    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:12.058115 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:12.058008    2574 generic.go:356] "Generic (PLEG): container finished" podID="c0ada96f-0a98-4af7-b788-799c1c27bf8d" containerID="18584986f65b553952e0780f97cf977bdd356d223c63a271bdb2939a58dc586f" exitCode=0
Jul 10 16:42:12.058115 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:12.058085    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q" event={"ID":"c0ada96f-0a98-4af7-b788-799c1c27bf8d","Type":"ContainerDied","Data":"18584986f65b553952e0780f97cf977bdd356d223c63a271bdb2939a58dc586f"}
Jul 10 16:42:12.058515 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:12.058442    2574 scope.go:117] "RemoveContainer" containerID="18584986f65b553952e0780f97cf977bdd356d223c63a271bdb2939a58dc586f"
Jul 10 16:42:12.672154 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:12.672112    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:12.772322 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:12.772280    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:13.063786 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:13.063706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pvc2q" event={"ID":"c0ada96f-0a98-4af7-b788-799c1c27bf8d","Type":"ContainerStarted","Data":"3fd4b989e1bdb4be24d45d016987f80164583960e00b34f809c09ee47f43cfb4"}
Jul 10 16:42:23.662993 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:23.662959    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:23.682996 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:23.682970    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:24.124555 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:24.124466    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:33.137988 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:33.137945    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:33.194211 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:33.194171    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:33.653271 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:33.653233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:42:33.655463 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:33.655433    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6df769b8-14bb-4309-b135-f356e95f75e1-metrics-certs\") pod \"network-metrics-daemon-qlswx\" (UID: \"6df769b8-14bb-4309-b135-f356e95f75e1\") " pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:42:33.664695 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:33.664674    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bc5mm\""
Jul 10 16:42:33.672210 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:33.672190    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qlswx"
Jul 10 16:42:33.802567 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:33.802535    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qlswx"]
Jul 10 16:42:33.805556 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:42:33.805528    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df769b8_14bb_4309_b135_f356e95f75e1.slice/crio-2bff2e89fe58d947933bf4d84d78495aa7c2fc7e41df9a4da32a1635913eda93 WatchSource:0}: Error finding container 2bff2e89fe58d947933bf4d84d78495aa7c2fc7e41df9a4da32a1635913eda93: Status 404 returned error can't find the container with id 2bff2e89fe58d947933bf4d84d78495aa7c2fc7e41df9a4da32a1635913eda93
Jul 10 16:42:34.155755 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:34.155723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qlswx" event={"ID":"6df769b8-14bb-4309-b135-f356e95f75e1","Type":"ContainerStarted","Data":"2bff2e89fe58d947933bf4d84d78495aa7c2fc7e41df9a4da32a1635913eda93"}
Jul 10 16:42:34.590457 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:34.590369    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:35.163100 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:35.163013    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qlswx" event={"ID":"6df769b8-14bb-4309-b135-f356e95f75e1","Type":"ContainerStarted","Data":"d8905e107d7e0f2aea510c0aa94a5c1363776b7416f9d8554ba0bd0cf105af11"}
Jul 10 16:42:35.163100 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:35.163080    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qlswx" event={"ID":"6df769b8-14bb-4309-b135-f356e95f75e1","Type":"ContainerStarted","Data":"30256f30ccb4a6dddc4743b22ac9ceae7cdde6665daf0dba0643dbb11df041ca"}
Jul 10 16:42:35.184709 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:35.184655    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qlswx" podStartSLOduration=374.085962555 podStartE2EDuration="6m15.184638881s" totalImagesPullingTime="1.098676326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:42:35.182429041 +0000 UTC m=+375.782604697" watchObservedRunningTime="2026-07-10 16:42:35.184638881 +0000 UTC m=+375.784814584"
Jul 10 16:42:35.325197 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:35.325157    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:35.434650 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:35.434556    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:37.376984 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.376948    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 16:42:37.377373 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.377234    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="alertmanager" containerID="cri-o://90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719" gracePeriod=120
Jul 10 16:42:37.377373 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.377306    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy-web" containerID="cri-o://980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836" gracePeriod=120
Jul 10 16:42:37.377373 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.377343    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy" containerID="cri-o://4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7" gracePeriod=120
Jul 10 16:42:37.377544 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.377362    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="prom-label-proxy" containerID="cri-o://3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6" gracePeriod=120
Jul 10 16:42:37.377544 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.377302    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy-metric" containerID="cri-o://f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe" gracePeriod=120
Jul 10 16:42:37.377544 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.377314    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="config-reloader" containerID="cri-o://64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1" gracePeriod=120
Jul 10 16:42:37.600423 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.600375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:37.701888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:37.701854    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:38.180610 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.180577    2574 generic.go:356] "Generic (PLEG): container finished" podID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerID="3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6" exitCode=0
Jul 10 16:42:38.180610 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.180601    2574 generic.go:356] "Generic (PLEG): container finished" podID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerID="4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7" exitCode=0
Jul 10 16:42:38.180610 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.180607    2574 generic.go:356] "Generic (PLEG): container finished" podID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerID="64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1" exitCode=0
Jul 10 16:42:38.180610 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.180613    2574 generic.go:356] "Generic (PLEG): container finished" podID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerID="90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719" exitCode=0
Jul 10 16:42:38.180888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.180647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerDied","Data":"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6"}
Jul 10 16:42:38.180888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.180710    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerDied","Data":"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7"}
Jul 10 16:42:38.180888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.180739    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerDied","Data":"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1"}
Jul 10 16:42:38.180888 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.180763    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerDied","Data":"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719"}
Jul 10 16:42:38.629292 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.629264    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:42:38.796242 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796151    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-tls-assets\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796242 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796203    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796242 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796231    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-cluster-tls-config\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796251    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-trusted-ca-bundle\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796267    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-volume\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796284    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-web-config\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796311    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-out\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796340    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-web\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796383    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-metrics-client-ca\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796421    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-main-tls\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796453    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796491    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-main-db\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.796536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.796527    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w728r\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-kube-api-access-w728r\") pod \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\" (UID: \"380d9a21-c303-43c0-ac3c-ba45afe9a85f\") "
Jul 10 16:42:38.797081 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.797049    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:38.797486 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.797456    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:38.797791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.797764    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 16:42:38.799051 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.799024    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:42:38.799295 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.799271    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-volume" (OuterVolumeSpecName: "config-volume") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:38.799679 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.799641    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-kube-api-access-w728r" (OuterVolumeSpecName: "kube-api-access-w728r") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "kube-api-access-w728r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:42:38.799947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.799903    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:38.800101 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.800075    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-out" (OuterVolumeSpecName: "config-out") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 16:42:38.800448 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.800415    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:38.800627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.800602    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:38.801332 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.801307    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:38.804157 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.804134    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:38.811286 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.811265    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-web-config" (OuterVolumeSpecName: "web-config") pod "380d9a21-c303-43c0-ac3c-ba45afe9a85f" (UID: "380d9a21-c303-43c0-ac3c-ba45afe9a85f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:38.898216 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898180    2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-tls-assets\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898216 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898212    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898216 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898223    2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-cluster-tls-config\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898232    2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898240    2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-volume\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898248    2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-web-config\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898255    2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-config-out\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898263    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898271    2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/380d9a21-c303-43c0-ac3c-ba45afe9a85f-metrics-client-ca\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898279    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-main-tls\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898288    2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/380d9a21-c303-43c0-ac3c-ba45afe9a85f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898299    2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/380d9a21-c303-43c0-ac3c-ba45afe9a85f-alertmanager-main-db\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:38.898435 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:38.898307    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w728r\" (UniqueName: \"kubernetes.io/projected/380d9a21-c303-43c0-ac3c-ba45afe9a85f-kube-api-access-w728r\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:39.187612 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.187568    2574 generic.go:356] "Generic (PLEG): container finished" podID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerID="f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe" exitCode=0
Jul 10 16:42:39.187612 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.187598    2574 generic.go:356] "Generic (PLEG): container finished" podID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerID="980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836" exitCode=0
Jul 10 16:42:39.187799 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.187633    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerDied","Data":"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe"}
Jul 10 16:42:39.187799 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.187646    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 16:42:39.187799 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.187702    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerDied","Data":"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836"}
Jul 10 16:42:39.187799 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.187735    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"380d9a21-c303-43c0-ac3c-ba45afe9a85f","Type":"ContainerDied","Data":"15435fe3a3e29dcbf0d710658dc30639e9706c380423e1ad063e0be7577955c6"}
Jul 10 16:42:39.187919 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.187775    2574 scope.go:117] "RemoveContainer" containerID="3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6"
Jul 10 16:42:39.196467 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.196445    2574 scope.go:117] "RemoveContainer" containerID="f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe"
Jul 10 16:42:39.203902 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.203888    2574 scope.go:117] "RemoveContainer" containerID="4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7"
Jul 10 16:42:39.210671 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.210656    2574 scope.go:117] "RemoveContainer" containerID="980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836"
Jul 10 16:42:39.213304 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.213282    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 16:42:39.216777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.216755    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 16:42:39.219089 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.219073    2574 scope.go:117] "RemoveContainer" containerID="64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1"
Jul 10 16:42:39.225873 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.225857    2574 scope.go:117] "RemoveContainer" containerID="90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719"
Jul 10 16:42:39.233447 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.233432    2574 scope.go:117] "RemoveContainer" containerID="a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3"
Jul 10 16:42:39.240765 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.240747    2574 scope.go:117] "RemoveContainer" containerID="3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6"
Jul 10 16:42:39.241064 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:39.241038    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6\": container with ID starting with 3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6 not found: ID does not exist" containerID="3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6"
Jul 10 16:42:39.241135 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.241073    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6"} err="failed to get container status \"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6\": rpc error: code = NotFound desc = could not find container \"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6\": container with ID starting with 3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6 not found: ID does not exist"
Jul 10 16:42:39.241135 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.241094    2574 scope.go:117] "RemoveContainer" containerID="f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe"
Jul 10 16:42:39.241326 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:39.241311    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe\": container with ID starting with f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe not found: ID does not exist" containerID="f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe"
Jul 10 16:42:39.241365 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.241332    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe"} err="failed to get container status \"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe\": rpc error: code = NotFound desc = could not find container \"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe\": container with ID starting with f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe not found: ID does not exist"
Jul 10 16:42:39.241365 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.241345    2574 scope.go:117] "RemoveContainer" containerID="4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7"
Jul 10 16:42:39.241585 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:39.241565    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7\": container with ID starting with 4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7 not found: ID does not exist" containerID="4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7"
Jul 10 16:42:39.241625 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.241591    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7"} err="failed to get container status \"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7\": rpc error: code = NotFound desc = could not find container \"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7\": container with ID starting with 4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7 not found: ID does not exist"
Jul 10 16:42:39.241625 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.241607    2574 scope.go:117] "RemoveContainer" containerID="980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836"
Jul 10 16:42:39.241856 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:39.241839    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836\": container with ID starting with 980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836 not found: ID does not exist" containerID="980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836"
Jul 10 16:42:39.241907 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.241860    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836"} err="failed to get container status \"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836\": rpc error: code = NotFound desc = could not find container \"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836\": container with ID starting with 980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836 not found: ID does not exist"
Jul 10 16:42:39.241907 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.241873    2574 scope.go:117] "RemoveContainer" containerID="64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1"
Jul 10 16:42:39.242109 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:39.242095    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1\": container with ID starting with 64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1 not found: ID does not exist" containerID="64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1"
Jul 10 16:42:39.242165 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.242114    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1"} err="failed to get container status \"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1\": rpc error: code = NotFound desc = could not find container \"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1\": container with ID starting with 64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1 not found: ID does not exist"
Jul 10 16:42:39.242165 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.242134    2574 scope.go:117] "RemoveContainer" containerID="90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719"
Jul 10 16:42:39.242355 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:39.242337    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719\": container with ID starting with 90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719 not found: ID does not exist" containerID="90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719"
Jul 10 16:42:39.242398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.242360    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719"} err="failed to get container status \"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719\": rpc error: code = NotFound desc = could not find container \"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719\": container with ID starting with 90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719 not found: ID does not exist"
Jul 10 16:42:39.242398 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.242379    2574 scope.go:117] "RemoveContainer" containerID="a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3"
Jul 10 16:42:39.242607 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:39.242591    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3\": container with ID starting with a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3 not found: ID does not exist" containerID="a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3"
Jul 10 16:42:39.242648 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.242611    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3"} err="failed to get container status \"a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3\": rpc error: code = NotFound desc = could not find container \"a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3\": container with ID starting with a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3 not found: ID does not exist"
Jul 10 16:42:39.242648 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.242624    2574 scope.go:117] "RemoveContainer" containerID="3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6"
Jul 10 16:42:39.242853 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.242830    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6"} err="failed to get container status \"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6\": rpc error: code = NotFound desc = could not find container \"3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6\": container with ID starting with 3c4a1d5085b00af37ae8c3c810efae282a4b48ef7fbce784b466a85d528c63d6 not found: ID does not exist"
Jul 10 16:42:39.242853 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.242847    2574 scope.go:117] "RemoveContainer" containerID="f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe"
Jul 10 16:42:39.243108 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243089    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe"} err="failed to get container status \"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe\": rpc error: code = NotFound desc = could not find container \"f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe\": container with ID starting with f9db420db21bac7a49190a55f56d6d29659eb10806f76c5085af0a70049353fe not found: ID does not exist"
Jul 10 16:42:39.243108 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243108    2574 scope.go:117] "RemoveContainer" containerID="4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7"
Jul 10 16:42:39.243320 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243301    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7"} err="failed to get container status \"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7\": rpc error: code = NotFound desc = could not find container \"4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7\": container with ID starting with 4ab8ef7fdd72352ee486c99a117d260f833ffb5975b3e5e29db60bc892c746a7 not found: ID does not exist"
Jul 10 16:42:39.243320 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243319    2574 scope.go:117] "RemoveContainer" containerID="980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836"
Jul 10 16:42:39.243528 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243511    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836"} err="failed to get container status \"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836\": rpc error: code = NotFound desc = could not find container \"980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836\": container with ID starting with 980fda53d8e074556b64a7bb199a53c667f8d15ac01356c4ba1b04b5f52cc836 not found: ID does not exist"
Jul 10 16:42:39.243572 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243528    2574 scope.go:117] "RemoveContainer" containerID="64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1"
Jul 10 16:42:39.243702 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243687    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1"} err="failed to get container status \"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1\": rpc error: code = NotFound desc = could not find container \"64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1\": container with ID starting with 64230f7f673e0e0d3684a7e9ae5d703d6c5731935e2d605f565f7f32100cd9b1 not found: ID does not exist"
Jul 10 16:42:39.243740 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243703    2574 scope.go:117] "RemoveContainer" containerID="90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719"
Jul 10 16:42:39.243880 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243865    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719"} err="failed to get container status \"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719\": rpc error: code = NotFound desc = could not find container \"90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719\": container with ID starting with 90ea7b34f8ff0b84f7a0e7fc74fd3fcc2a27044b93e1cec998968e1fb13e3719 not found: ID does not exist"
Jul 10 16:42:39.243941 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.243880    2574 scope.go:117] "RemoveContainer" containerID="a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3"
Jul 10 16:42:39.244101 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.244082    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3"} err="failed to get container status \"a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3\": rpc error: code = NotFound desc = could not find container \"a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3\": container with ID starting with a33fc49a6165e658ae18d6b7da688c8ef80f83e099ab900e9c08b1e4350684f3 not found: ID does not exist"
Jul 10 16:42:39.866100 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:39.866025    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" path="/var/lib/kubelet/pods/380d9a21-c303-43c0-ac3c-ba45afe9a85f/volumes"
Jul 10 16:42:41.629481 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:41.629444    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:42:41.629966 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:41.629818    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="prometheus" containerID="cri-o://c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89" gracePeriod=600
Jul 10 16:42:41.629966 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:41.629859    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe" gracePeriod=600
Jul 10 16:42:41.629966 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:41.629907    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy" containerID="cri-o://a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38" gracePeriod=600
Jul 10 16:42:41.629966 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:41.629949    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="thanos-sidecar" containerID="cri-o://3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb" gracePeriod=600
Jul 10 16:42:41.630191 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:41.630023    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="config-reloader" containerID="cri-o://9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45" gracePeriod=600
Jul 10 16:42:41.630191 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:41.630084    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy-web" containerID="cri-o://a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de" gracePeriod=600
Jul 10 16:42:42.204651 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204615    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerID="7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe" exitCode=0
Jul 10 16:42:42.204651 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204643    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerID="a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38" exitCode=0
Jul 10 16:42:42.204651 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204650    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerID="3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb" exitCode=0
Jul 10 16:42:42.204651 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204656    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerID="9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45" exitCode=0
Jul 10 16:42:42.204912 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204662    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerID="c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89" exitCode=0
Jul 10 16:42:42.204912 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204689    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerDied","Data":"7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe"}
Jul 10 16:42:42.204912 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerDied","Data":"a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38"}
Jul 10 16:42:42.204912 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerDied","Data":"3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb"}
Jul 10 16:42:42.204912 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204801    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerDied","Data":"9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45"}
Jul 10 16:42:42.204912 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.204822    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerDied","Data":"c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89"}
Jul 10 16:42:42.881031 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:42.881006    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.037155 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037062    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-metrics-client-certs\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037155 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037101    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-kube-rbac-proxy\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037155 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037127    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-web-config\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037155 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037151    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037481 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037267    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-grpc-tls\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037481 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037312    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-2\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037481 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037348    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-serving-certs-ca-bundle\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037481 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037378    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-kubelet-serving-ca-bundle\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037481 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037436    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-db\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037481 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037463    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdzzg\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-kube-api-access-qdzzg\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037489    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-thanos-prometheus-http-client-file\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037520    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config-out\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037581    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-metrics-client-ca\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037627    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-trusted-ca-bundle\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037656    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037686    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037696    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037740    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-1\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037773    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-tls\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037801    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-tls-assets\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.037823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.037825    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-0\") pod \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\" (UID: \"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d\") "
Jul 10 16:42:43.038403 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.038110    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:43.038403 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.038186    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.038403 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.038207    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.039224 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.038765    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:43.039224 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.039185    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:43.039472 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.039223    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 16:42:43.039472 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.039249    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:43.039472 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.039439    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:43.039884 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.039843    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.040462 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.040433    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:42:43.041268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.041227    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.041661 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.041634    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config" (OuterVolumeSpecName: "config") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.041861 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.041825    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.041978 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.041902    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-kube-api-access-qdzzg" (OuterVolumeSpecName: "kube-api-access-qdzzg") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "kube-api-access-qdzzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:42:43.042078 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.042052    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config-out" (OuterVolumeSpecName: "config-out") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 16:42:43.042301 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.042279    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.043132 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.043103    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:42:43.043233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.043147    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.043233 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.043167    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.043399 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.043378    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.052335 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.052304    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-web-config" (OuterVolumeSpecName: "web-config") pod "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" (UID: "4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:42:43.138856 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138811    2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-tls-assets\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.138856 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138852    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.138856 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138863    2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-metrics-client-certs\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.138856 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138872    2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-kube-rbac-proxy\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138881    2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-web-config\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138891    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138901    2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-grpc-tls\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138910    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138918    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-db\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138947    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdzzg\" (UniqueName: \"kubernetes.io/projected/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-kube-api-access-qdzzg\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138957    2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138966    2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config-out\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138975    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-configmap-metrics-client-ca\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138984    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.138993    2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-config\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.139001    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.139010    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.139125 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.139019    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:42:43.214419 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.214373    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerID="a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de" exitCode=0
Jul 10 16:42:43.214603 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.214424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerDied","Data":"a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de"}
Jul 10 16:42:43.214603 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.214476    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.214603 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.214503    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d","Type":"ContainerDied","Data":"14fba204322b1cc71327152b0b106dd311a95c5951e6941db4e6303cc73f9738"}
Jul 10 16:42:43.214603 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.214540    2574 scope.go:117] "RemoveContainer" containerID="7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe"
Jul 10 16:42:43.224167 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.224147    2574 scope.go:117] "RemoveContainer" containerID="a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38"
Jul 10 16:42:43.231657 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.231637    2574 scope.go:117] "RemoveContainer" containerID="a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de"
Jul 10 16:42:43.238897 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.238875    2574 scope.go:117] "RemoveContainer" containerID="3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb"
Jul 10 16:42:43.239730 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.239711    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:42:43.243388 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.243360    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:42:43.246421 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.246400    2574 scope.go:117] "RemoveContainer" containerID="9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45"
Jul 10 16:42:43.253275 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.253257    2574 scope.go:117] "RemoveContainer" containerID="c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89"
Jul 10 16:42:43.260546 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.260531    2574 scope.go:117] "RemoveContainer" containerID="13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4"
Jul 10 16:42:43.267072 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.267032    2574 scope.go:117] "RemoveContainer" containerID="7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe"
Jul 10 16:42:43.267482 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:43.267452    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe\": container with ID starting with 7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe not found: ID does not exist" containerID="7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe"
Jul 10 16:42:43.267552 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.267490    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe"} err="failed to get container status \"7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe\": rpc error: code = NotFound desc = could not find container \"7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe\": container with ID starting with 7020ccf1ff3b250d59ffd3a66f2989ea1bede1b16e85913279c10ea875c1a1fe not found: ID does not exist"
Jul 10 16:42:43.267552 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.267515    2574 scope.go:117] "RemoveContainer" containerID="a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38"
Jul 10 16:42:43.267811 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:43.267789    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38\": container with ID starting with a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38 not found: ID does not exist" containerID="a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38"
Jul 10 16:42:43.267904 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.267815    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38"} err="failed to get container status \"a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38\": rpc error: code = NotFound desc = could not find container \"a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38\": container with ID starting with a2c363251fe4a37a08738ac558bd796d6cc13177aab5950e676cb1ca4eb71f38 not found: ID does not exist"
Jul 10 16:42:43.267904 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.267833    2574 scope.go:117] "RemoveContainer" containerID="a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de"
Jul 10 16:42:43.268117 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:43.268098    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de\": container with ID starting with a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de not found: ID does not exist" containerID="a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de"
Jul 10 16:42:43.268175 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.268121    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de"} err="failed to get container status \"a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de\": rpc error: code = NotFound desc = could not find container \"a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de\": container with ID starting with a5ea7577dda83a470ba681edf02e170868b9864bc30a7fae736ac1e2169716de not found: ID does not exist"
Jul 10 16:42:43.268175 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.268133    2574 scope.go:117] "RemoveContainer" containerID="3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb"
Jul 10 16:42:43.268366 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:43.268349    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb\": container with ID starting with 3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb not found: ID does not exist" containerID="3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb"
Jul 10 16:42:43.268440 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.268371    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb"} err="failed to get container status \"3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb\": rpc error: code = NotFound desc = could not find container \"3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb\": container with ID starting with 3579c5011c8871ac5a8f0ab85c5374ec426818932dc6125cc8040959b2f0a6cb not found: ID does not exist"
Jul 10 16:42:43.268440 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.268387    2574 scope.go:117] "RemoveContainer" containerID="9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45"
Jul 10 16:42:43.268658 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:43.268639    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45\": container with ID starting with 9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45 not found: ID does not exist" containerID="9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45"
Jul 10 16:42:43.268714 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.268661    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45"} err="failed to get container status \"9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45\": rpc error: code = NotFound desc = could not find container \"9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45\": container with ID starting with 9f136b06e6fb755efb584b5441a4528255bf61a1c9203e2d141281491987dc45 not found: ID does not exist"
Jul 10 16:42:43.268714 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.268675    2574 scope.go:117] "RemoveContainer" containerID="c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89"
Jul 10 16:42:43.268880 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:43.268865    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89\": container with ID starting with c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89 not found: ID does not exist" containerID="c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89"
Jul 10 16:42:43.268969 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.268883    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89"} err="failed to get container status \"c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89\": rpc error: code = NotFound desc = could not find container \"c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89\": container with ID starting with c167ec4089550d8f2064dbe15d786f7111b800a2e7a11344916ec4c3b3199e89 not found: ID does not exist"
Jul 10 16:42:43.268969 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.268895    2574 scope.go:117] "RemoveContainer" containerID="13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4"
Jul 10 16:42:43.269235 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269214    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:42:43.269317 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:42:43.269247    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4\": container with ID starting with 13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4 not found: ID does not exist" containerID="13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4"
Jul 10 16:42:43.269317 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269271    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4"} err="failed to get container status \"13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4\": rpc error: code = NotFound desc = could not find container \"13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4\": container with ID starting with 13124f3d5f1cf55fcb72884d860c5257c6ce71e1b88673692a1a045de679d9b4 not found: ID does not exist"
Jul 10 16:42:43.269532 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269521    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy-metric"
Jul 10 16:42:43.269566 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269535    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy-metric"
Jul 10 16:42:43.269566 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269543    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="config-reloader"
Jul 10 16:42:43.269566 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269549    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="config-reloader"
Jul 10 16:42:43.269566 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269555    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy-web"
Jul 10 16:42:43.269566 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269561    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy-web"
Jul 10 16:42:43.269566 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269566    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy-web"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269572    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy-web"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269580    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="init-config-reloader"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269587    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="init-config-reloader"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269595    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="prometheus"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269600    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="prometheus"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269611    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy-thanos"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269616    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy-thanos"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269622    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebfcdd4e-973e-42c7-b37b-010772cefa07" containerName="registry"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269627    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebfcdd4e-973e-42c7-b37b-010772cefa07" containerName="registry"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269633    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="config-reloader"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269638    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="config-reloader"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269644    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="thanos-sidecar"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269648    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="thanos-sidecar"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269655    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269660    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269666    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="init-config-reloader"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269671    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="init-config-reloader"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269677    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="alertmanager"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269681    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="alertmanager"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269686    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="prom-label-proxy"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269691    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="prom-label-proxy"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269696    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy"
Jul 10 16:42:43.269739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269701    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269750    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy-web"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269756    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy-metric"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269761    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="prom-label-proxy"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269769    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="thanos-sidecar"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269775    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="prometheus"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269781    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269787    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="kube-rbac-proxy"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269793    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy-thanos"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269799    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="config-reloader"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269805    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" containerName="kube-rbac-proxy-web"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269811    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="alertmanager"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269815    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebfcdd4e-973e-42c7-b37b-010772cefa07" containerName="registry"
Jul 10 16:42:43.270374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.269821    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="380d9a21-c303-43c0-ac3c-ba45afe9a85f" containerName="config-reloader"
Jul 10 16:42:43.274850 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.274834    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.277988 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.277964    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 16:42:43.277988 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.277972    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 16:42:43.278151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278034    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 16:42:43.278151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278078    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qcjnt\""
Jul 10 16:42:43.278151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278096    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 16:42:43.278151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278043    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 16:42:43.278151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278081    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 16:42:43.278399 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278143    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-112lvidamruv3\""
Jul 10 16:42:43.278399 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278296    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 16:42:43.278399 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278342    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 16:42:43.278575 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278559    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 16:42:43.278767 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278752    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 16:42:43.278767 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.278763    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 16:42:43.279020 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.279005    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 16:42:43.279257 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.279211    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 16:42:43.281155 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.281136    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 16:42:43.283379 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.283361    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 16:42:43.288499 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.288458    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:42:43.441433 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441586 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441586 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441586 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441520    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9889753-5d10-47c9-9c76-108a7d92ac63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441692 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441585    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441692 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441692 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441636    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441692 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441692 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441682    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441950 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28n6j\" (UniqueName: \"kubernetes.io/projected/b9889753-5d10-47c9-9c76-108a7d92ac63-kube-api-access-28n6j\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441950 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9889753-5d10-47c9-9c76-108a7d92ac63-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441950 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441950 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441840    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441950 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441866    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441950 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.441950 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441923    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.442198 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.441999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-config\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.442198 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.442021    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.442198 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.442049    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.442198 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.442069    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.542801 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.542801 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.542801 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.542801 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542792    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28n6j\" (UniqueName: \"kubernetes.io/projected/b9889753-5d10-47c9-9c76-108a7d92ac63-kube-api-access-28n6j\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9889753-5d10-47c9-9c76-108a7d92ac63-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542908    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.542986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543013    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543051    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-config\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543076    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543113    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543176    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543200 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543203    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543868 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543868 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543289    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9889753-5d10-47c9-9c76-108a7d92ac63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543868 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543567    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.543868 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.543612    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.544240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.544216    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.545138 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.545110    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547466 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.545764    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547466 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.545985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9889753-5d10-47c9-9c76-108a7d92ac63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547466 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.545992    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-web-config\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547466 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.546013    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547466 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.546275    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547466 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.546526    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547466 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.546761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547466 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.547192    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.547871 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.547507    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b9889753-5d10-47c9-9c76-108a7d92ac63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.548007 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.547988    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9889753-5d10-47c9-9c76-108a7d92ac63-config-out\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.548253 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.548233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.548311 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.548267    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-config\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.548311 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.548275    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.549304 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.549285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.549471 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.549451    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b9889753-5d10-47c9-9c76-108a7d92ac63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.551236 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.551220    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28n6j\" (UniqueName: \"kubernetes.io/projected/b9889753-5d10-47c9-9c76-108a7d92ac63-kube-api-access-28n6j\") pod \"prometheus-k8s-0\" (UID: \"b9889753-5d10-47c9-9c76-108a7d92ac63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.585790 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.585765    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:43.725185 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.725157    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 16:42:43.728453 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:42:43.728427    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9889753_5d10_47c9_9c76_108a7d92ac63.slice/crio-c6e4dd98c267ab21d01f8bcc8e90fd3bd98c33ce57d63b6fcf7e2c41c531076d WatchSource:0}: Error finding container c6e4dd98c267ab21d01f8bcc8e90fd3bd98c33ce57d63b6fcf7e2c41c531076d: Status 404 returned error can't find the container with id c6e4dd98c267ab21d01f8bcc8e90fd3bd98c33ce57d63b6fcf7e2c41c531076d
Jul 10 16:42:43.865992 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:43.865965    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d" path="/var/lib/kubelet/pods/4ee3bacf-6267-4ca0-b37d-2ae1bb03ab0d/volumes"
Jul 10 16:42:44.226980 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:44.226920    2574 generic.go:356] "Generic (PLEG): container finished" podID="b9889753-5d10-47c9-9c76-108a7d92ac63" containerID="56cf65d93c7c84c4cbde2e3b072b9e5dd2abe8d42e496a3ded3d0cdebb12cb28" exitCode=0
Jul 10 16:42:44.226980 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:44.226965    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9889753-5d10-47c9-9c76-108a7d92ac63","Type":"ContainerDied","Data":"56cf65d93c7c84c4cbde2e3b072b9e5dd2abe8d42e496a3ded3d0cdebb12cb28"}
Jul 10 16:42:44.227482 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:44.227048    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9889753-5d10-47c9-9c76-108a7d92ac63","Type":"ContainerStarted","Data":"c6e4dd98c267ab21d01f8bcc8e90fd3bd98c33ce57d63b6fcf7e2c41c531076d"}
Jul 10 16:42:45.124421 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.124387    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:45.181097 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.181064    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:45.235343 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.235306    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9889753-5d10-47c9-9c76-108a7d92ac63","Type":"ContainerStarted","Data":"4c3529770d1ff579f339b4845b888dd995dfd914a055306b1c8248772703bd00"}
Jul 10 16:42:45.235750 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.235371    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9889753-5d10-47c9-9c76-108a7d92ac63","Type":"ContainerStarted","Data":"20976c14d3c5b7743bf1497602d803e4a6142b4372c92b1e75ea39df2caa68be"}
Jul 10 16:42:45.235750 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.235397    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9889753-5d10-47c9-9c76-108a7d92ac63","Type":"ContainerStarted","Data":"48620b4d336cf5a177d624e26e63087dd7f80af9ec46ce04ca1d0677a87cb001"}
Jul 10 16:42:45.235750 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.235422    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9889753-5d10-47c9-9c76-108a7d92ac63","Type":"ContainerStarted","Data":"d2f500e7a20783d2bcd07e2759f849a33e04258c81496ac245cef65a884e5ab7"}
Jul 10 16:42:45.235750 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.235450    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9889753-5d10-47c9-9c76-108a7d92ac63","Type":"ContainerStarted","Data":"803eda25e3111197fde75cdeeeec2c2f32cc5f6baa97572a372f790029b8c566"}
Jul 10 16:42:45.235750 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.235474    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b9889753-5d10-47c9-9c76-108a7d92ac63","Type":"ContainerStarted","Data":"f86b8eb95d98dee0ba08eee3a9dfc5655cc41ae077b282ef0eea6bf37e29eef4"}
Jul 10 16:42:45.267143 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:45.267089    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.241913678 podStartE2EDuration="2.267073383s" totalImagesPullingTime="0s" totalInitContainerRuntime="25.159705ms" isStatefulPod=false podCreationTimestamp="2026-07-10 16:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:42:45.265255104 +0000 UTC m=+385.865430759" watchObservedRunningTime="2026-07-10 16:42:45.267073383 +0000 UTC m=+385.867249038"
Jul 10 16:42:48.586186 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:48.586152    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:42:54.931377 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:54.931340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:54.984196 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:54.984160    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:57.411428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:57.411398    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:57.511757 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:57.511721    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:42:57.611209 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:42:57.611180    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:43:05.479944 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:43:05.479900    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:43:05.592477 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:43:05.592437    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:43:05.718727 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:43:05.718693    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:43:42.768678 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:43:42.768644    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:43:42.822261 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:43:42.822226    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:43:43.586291 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:43:43.586246    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:43:43.601747 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:43:43.601722    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:43:44.490248 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:43:44.490215    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 16:44:03.561725 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:03.561673    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:03.656025 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:03.655993    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:05.462710 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:05.462677    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:30.253170 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:30.253128    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:31.058668 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:31.058625    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:33.981807 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:33.981773    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:34.074439 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:34.074398    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:35.392699 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:35.392659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:35.514535 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:35.514492    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:35.845791 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:35.845752    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:35.937956 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:35.937896    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:38.244185 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:38.244141    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:38.650597 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:38.650565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:40.655968 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:40.655908    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:40.709981 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:40.709948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:43.473426 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:43.473391    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:43.573782 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:43.573755    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:45.848740 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:45.848711    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:46.676740 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:46.676702    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:46.773918 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:46.773888    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:48.459518 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.459484    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-khp9t"]
Jul 10 16:44:48.462989 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.462971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-khp9t"
Jul 10 16:44:48.465983 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.465966    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 16:44:48.466085 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.465971    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vv5z6\""
Jul 10 16:44:48.467413 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.467398    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 16:44:48.472610 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.472589    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-khp9t"]
Jul 10 16:44:48.516318 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.516289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9773d5a8-8a68-4172-8753-a7eba8bdb655-bound-sa-token\") pod \"cert-manager-55b4d954d5-khp9t\" (UID: \"9773d5a8-8a68-4172-8753-a7eba8bdb655\") " pod="cert-manager/cert-manager-55b4d954d5-khp9t"
Jul 10 16:44:48.516470 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.516403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpgdw\" (UniqueName: \"kubernetes.io/projected/9773d5a8-8a68-4172-8753-a7eba8bdb655-kube-api-access-vpgdw\") pod \"cert-manager-55b4d954d5-khp9t\" (UID: \"9773d5a8-8a68-4172-8753-a7eba8bdb655\") " pod="cert-manager/cert-manager-55b4d954d5-khp9t"
Jul 10 16:44:48.617613 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.617583    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9773d5a8-8a68-4172-8753-a7eba8bdb655-bound-sa-token\") pod \"cert-manager-55b4d954d5-khp9t\" (UID: \"9773d5a8-8a68-4172-8753-a7eba8bdb655\") " pod="cert-manager/cert-manager-55b4d954d5-khp9t"
Jul 10 16:44:48.617779 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.617668    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpgdw\" (UniqueName: \"kubernetes.io/projected/9773d5a8-8a68-4172-8753-a7eba8bdb655-kube-api-access-vpgdw\") pod \"cert-manager-55b4d954d5-khp9t\" (UID: \"9773d5a8-8a68-4172-8753-a7eba8bdb655\") " pod="cert-manager/cert-manager-55b4d954d5-khp9t"
Jul 10 16:44:48.626360 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.626337    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9773d5a8-8a68-4172-8753-a7eba8bdb655-bound-sa-token\") pod \"cert-manager-55b4d954d5-khp9t\" (UID: \"9773d5a8-8a68-4172-8753-a7eba8bdb655\") " pod="cert-manager/cert-manager-55b4d954d5-khp9t"
Jul 10 16:44:48.626618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.626596    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpgdw\" (UniqueName: \"kubernetes.io/projected/9773d5a8-8a68-4172-8753-a7eba8bdb655-kube-api-access-vpgdw\") pod \"cert-manager-55b4d954d5-khp9t\" (UID: \"9773d5a8-8a68-4172-8753-a7eba8bdb655\") " pod="cert-manager/cert-manager-55b4d954d5-khp9t"
Jul 10 16:44:48.659121 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.659091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:48.787098 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.787020    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-khp9t"
Jul 10 16:44:48.916989 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:48.916966    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-khp9t"]
Jul 10 16:44:48.919136 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:44:48.919109    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9773d5a8_8a68_4172_8753_a7eba8bdb655.slice/crio-07126f4ad5b1bf848de87908a090ddaa7f4b86e9cad7f1674ca1ade3a708212d WatchSource:0}: Error finding container 07126f4ad5b1bf848de87908a090ddaa7f4b86e9cad7f1674ca1ade3a708212d: Status 404 returned error can't find the container with id 07126f4ad5b1bf848de87908a090ddaa7f4b86e9cad7f1674ca1ade3a708212d
Jul 10 16:44:49.748538 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:49.748500    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-khp9t" event={"ID":"9773d5a8-8a68-4172-8753-a7eba8bdb655","Type":"ContainerStarted","Data":"07126f4ad5b1bf848de87908a090ddaa7f4b86e9cad7f1674ca1ade3a708212d"}
Jul 10 16:44:52.765537 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:52.765503    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-khp9t" event={"ID":"9773d5a8-8a68-4172-8753-a7eba8bdb655","Type":"ContainerStarted","Data":"a56d01f2e59fc5a9326ba3f5538109554f8e49d59d19afad39bf030b9b5d4f3f"}
Jul 10 16:44:52.782250 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:52.782205    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-khp9t" podStartSLOduration=2.008051805 podStartE2EDuration="4.782189428s" totalImagesPullingTime="2.774137623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:44:52.780721303 +0000 UTC m=+513.380896971" watchObservedRunningTime="2026-07-10 16:44:52.782189428 +0000 UTC m=+513.382365083"
Jul 10 16:44:53.427108 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:53.427077    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:53.528748 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:53.528703    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:44:55.200632 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:44:55.200588    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:08.260769 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:08.260717    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:08.371635 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:08.371596    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:08.889391 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:08.889354    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:09.094495 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.094456    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:09.219302 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.219265    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:09.312099 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.312069    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"]
Jul 10 16:45:09.319482 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.319461    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.322447 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.322420    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 16:45:09.322447 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.322433    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 16:45:09.322657 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.322495    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 16:45:09.322657 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.322512    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v48n5\""
Jul 10 16:45:09.322811 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.322795    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 16:45:09.345054 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.345029    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"]
Jul 10 16:45:09.391581 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.391552    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48rbh\" (UniqueName: \"kubernetes.io/projected/664bba24-ec88-47b0-bbda-9572797e0428-kube-api-access-48rbh\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.391745 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.391652    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/664bba24-ec88-47b0-bbda-9572797e0428-tmp\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.391745 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.391711    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/664bba24-ec88-47b0-bbda-9572797e0428-manifests\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.391745 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.391736    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/664bba24-ec88-47b0-bbda-9572797e0428-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.391890 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.391758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/664bba24-ec88-47b0-bbda-9572797e0428-webhook-cert\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.434460 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.434425    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:09.493250 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.493177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/664bba24-ec88-47b0-bbda-9572797e0428-tmp\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.493250 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.493231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/664bba24-ec88-47b0-bbda-9572797e0428-manifests\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.493455 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.493266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/664bba24-ec88-47b0-bbda-9572797e0428-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.493455 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.493341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/664bba24-ec88-47b0-bbda-9572797e0428-webhook-cert\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.493455 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.493426    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48rbh\" (UniqueName: \"kubernetes.io/projected/664bba24-ec88-47b0-bbda-9572797e0428-kube-api-access-48rbh\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.493679 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.493659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/664bba24-ec88-47b0-bbda-9572797e0428-manifests\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.495495 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.495467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/664bba24-ec88-47b0-bbda-9572797e0428-apiservice-cert\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.495495 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.495483    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/664bba24-ec88-47b0-bbda-9572797e0428-tmp\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.495741 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.495722    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/664bba24-ec88-47b0-bbda-9572797e0428-webhook-cert\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.501411 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.501388    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48rbh\" (UniqueName: \"kubernetes.io/projected/664bba24-ec88-47b0-bbda-9572797e0428-kube-api-access-48rbh\") pod \"opendatahub-operator-controller-manager-585db49996-6fst9\" (UID: \"664bba24-ec88-47b0-bbda-9572797e0428\") " pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.538093 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.538063    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:09.631121 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.631084    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:09.635375 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.635348    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:09.743628 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.743556    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:09.799256 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.799234    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"]
Jul 10 16:45:09.801848 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:45:09.801819    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664bba24_ec88_47b0_bbda_9572797e0428.slice/crio-04187c6fe159371bcd498079cc7146abbb995ee3b435e2e9efc0416c4731d9d5 WatchSource:0}: Error finding container 04187c6fe159371bcd498079cc7146abbb995ee3b435e2e9efc0416c4731d9d5: Status 404 returned error can't find the container with id 04187c6fe159371bcd498079cc7146abbb995ee3b435e2e9efc0416c4731d9d5
Jul 10 16:45:09.842468 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.842432    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:09.846539 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.846491    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9" event={"ID":"664bba24-ec88-47b0-bbda-9572797e0428","Type":"ContainerStarted","Data":"04187c6fe159371bcd498079cc7146abbb995ee3b435e2e9efc0416c4731d9d5"}
Jul 10 16:45:09.953364 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:09.953330    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:10.092440 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:10.092352    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:13.414476 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:13.414443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:13.532040 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:13.532008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:13.869659 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:13.869577    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9" event={"ID":"664bba24-ec88-47b0-bbda-9572797e0428","Type":"ContainerStarted","Data":"526f9e06948aa5c92957308c21fe8eafb41c87213225bb0d880a02773b0de407"}
Jul 10 16:45:14.875601 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:14.875567    2574 generic.go:356] "Generic (PLEG): container finished" podID="664bba24-ec88-47b0-bbda-9572797e0428" containerID="526f9e06948aa5c92957308c21fe8eafb41c87213225bb0d880a02773b0de407" exitCode=0
Jul 10 16:45:14.876107 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:14.875612    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9" event={"ID":"664bba24-ec88-47b0-bbda-9572797e0428","Type":"ContainerDied","Data":"526f9e06948aa5c92957308c21fe8eafb41c87213225bb0d880a02773b0de407"}
Jul 10 16:45:15.881832 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:15.881797    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9" event={"ID":"664bba24-ec88-47b0-bbda-9572797e0428","Type":"ContainerStarted","Data":"dfbb3d78ff7fa53ffc881a62f09be4328b5d1b8adcbb6e14ea58a0fec7348603"}
Jul 10 16:45:15.882245 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:15.881948    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:15.905728 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:15.905684    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9" podStartSLOduration=2.470992104 podStartE2EDuration="6.905669654s" totalImagesPullingTime="3.41444852s" totalInitContainerRuntime="1.02022903s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:45:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:45:15.904337404 +0000 UTC m=+536.504513070" watchObservedRunningTime="2026-07-10 16:45:15.905669654 +0000 UTC m=+536.505845308"
Jul 10 16:45:20.428651 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:20.428613    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:20.534555 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:20.534523    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:26.889186 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:26.889157    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-585db49996-6fst9"
Jul 10 16:45:27.956272 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.956243    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"]
Jul 10 16:45:27.965131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.965114    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:27.973010 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.972989    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cc924\""
Jul 10 16:45:27.973010 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.973002    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 16:45:27.973399 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.973377    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 16:45:27.973512 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.973401    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 16:45:27.973512 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.973375    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 16:45:27.973682 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.973666    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 16:45:27.973891 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:27.973870    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"]
Jul 10 16:45:28.160800 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.160760    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfckl\" (UniqueName: \"kubernetes.io/projected/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-kube-api-access-hfckl\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.161006 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.160809    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-metrics-cert\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.161006 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.160954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-cert\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.161006 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.160993    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-manager-config\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.262338 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.262244    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-cert\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.262338 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.262301    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-manager-config\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.262338 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.262339    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfckl\" (UniqueName: \"kubernetes.io/projected/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-kube-api-access-hfckl\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.262554 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.262379    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-metrics-cert\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.263024 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.263003    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-manager-config\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.264919 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.264891    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-metrics-cert\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.265073 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.264943    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-cert\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.284522 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.284497    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfckl\" (UniqueName: \"kubernetes.io/projected/772d1a8f-0f43-4cac-ac4e-5f5023a71f32-kube-api-access-hfckl\") pod \"lws-controller-manager-655c89f56d-jm5wn\" (UID: \"772d1a8f-0f43-4cac-ac4e-5f5023a71f32\") " pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.481885 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.481848    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:28.574764 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.574677    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:28.644864 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.644829    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:28.731186 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.731163    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"]
Jul 10 16:45:28.733015 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:45:28.732985    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772d1a8f_0f43_4cac_ac4e_5f5023a71f32.slice/crio-188c3870b09251c603b59b6f8581bb366bb598a0a31abbca04b47b1badb10b72 WatchSource:0}: Error finding container 188c3870b09251c603b59b6f8581bb366bb598a0a31abbca04b47b1badb10b72: Status 404 returned error can't find the container with id 188c3870b09251c603b59b6f8581bb366bb598a0a31abbca04b47b1badb10b72
Jul 10 16:45:28.938481 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:28.938444    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn" event={"ID":"772d1a8f-0f43-4cac-ac4e-5f5023a71f32","Type":"ContainerStarted","Data":"188c3870b09251c603b59b6f8581bb366bb598a0a31abbca04b47b1badb10b72"}
Jul 10 16:45:29.276948 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:29.276844    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:29.375544 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:29.375485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:29.758037 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:29.757946    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:30.019031 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:30.018906    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:30.175818 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:30.175784    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:30.288401 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:30.288303    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:30.342087 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:30.342045    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:31.955914 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:31.955878    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn" event={"ID":"772d1a8f-0f43-4cac-ac4e-5f5023a71f32","Type":"ContainerStarted","Data":"3900d9bedd4d7e0f30699f613a1b2ca7ba84ebacc7f38ff2de2fe7b9fdadc9be"}
Jul 10 16:45:31.956333 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:31.956005    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:31.976014 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:31.975969    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn" podStartSLOduration=2.47716342 podStartE2EDuration="4.975953718s" totalImagesPullingTime="2.498790298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:45:31.97468078 +0000 UTC m=+552.574856462" watchObservedRunningTime="2026-07-10 16:45:31.975953718 +0000 UTC m=+552.576129367"
Jul 10 16:45:38.298386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:38.298345    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:38.394440 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:38.394405    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:38.746567 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:38.746536    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:38.991667 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:38.991624    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:39.571789 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.571756    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:39.668533 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.668498    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"]
Jul 10 16:45:39.671978 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.671958    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.685058 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.685032    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-skgsf\""
Jul 10 16:45:39.685058 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.685051    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 16:45:39.685240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.685098    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 16:45:39.685240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.685196    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 16:45:39.685240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.685235    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 16:45:39.706101 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.706070    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"]
Jul 10 16:45:39.739754 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.739719    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:39.761728 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.761698    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zphrg\" (UniqueName: \"kubernetes.io/projected/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-kube-api-access-zphrg\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.761872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.761733    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-tmp\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.761872 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.761755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-tls-certs\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.850806 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.850714    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:39.862983 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.862953    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zphrg\" (UniqueName: \"kubernetes.io/projected/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-kube-api-access-zphrg\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.863131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.862987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-tmp\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.863131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.863012    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-tls-certs\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.865405 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.865374    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-tmp\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.865670 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.865648    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-tls-certs\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.873202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.873173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zphrg\" (UniqueName: \"kubernetes.io/projected/bae91f70-d8ca-45a5-bcc6-d47c8a2476b8-kube-api-access-zphrg\") pod \"kube-auth-proxy-5778d5b958-jcw74\" (UID: \"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8\") " pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:39.987262 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:39.987228    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"
Jul 10 16:45:40.124157 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:40.124081    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5778d5b958-jcw74"]
Jul 10 16:45:40.127527 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:45:40.127498    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae91f70_d8ca_45a5_bcc6_d47c8a2476b8.slice/crio-1a33666c397ce785538a476212f96f2582dcbe89ba278a49156c6c1d18b8ac43 WatchSource:0}: Error finding container 1a33666c397ce785538a476212f96f2582dcbe89ba278a49156c6c1d18b8ac43: Status 404 returned error can't find the container with id 1a33666c397ce785538a476212f96f2582dcbe89ba278a49156c6c1d18b8ac43
Jul 10 16:45:41.004337 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:41.004305    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74" event={"ID":"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8","Type":"ContainerStarted","Data":"1a33666c397ce785538a476212f96f2582dcbe89ba278a49156c6c1d18b8ac43"}
Jul 10 16:45:41.593545 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:41.593512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:41.694144 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:41.694089    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:42.898146 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:42.898119    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:42.965348 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:42.965317    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-655c89f56d-jm5wn"
Jul 10 16:45:44.020378 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:44.020289    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74" event={"ID":"bae91f70-d8ca-45a5-bcc6-d47c8a2476b8","Type":"ContainerStarted","Data":"a2ed4613641d6ec53ae2d6a21ba15e1482eb7130946ea5f890617dc9169bfdd8"}
Jul 10 16:45:44.037444 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:44.037362    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5778d5b958-jcw74" podStartSLOduration=1.446087791 podStartE2EDuration="5.037342571s" totalImagesPullingTime="3.59125478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:45:44.03704181 +0000 UTC m=+564.637217490" watchObservedRunningTime="2026-07-10 16:45:44.037342571 +0000 UTC m=+564.637518224"
Jul 10 16:45:47.982168 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:47.982131    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:48.078393 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:48.078364    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:48.573783 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:48.573750    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:48.769517 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:48.769477    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:48.870777 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:48.870686    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:45:53.729148 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:45:53.729114    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:19.998730 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:19.998603    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:46:20.005448 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:20.001718    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:46:20.005448 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:20.004898    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:46:20.007589 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:20.007573    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:46:30.007331 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:30.007294    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:31.685427 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:31.685383    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:34.879163 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:34.879129    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:34.981809 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:34.981765    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:35.529706 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:35.529662    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:35.587382 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:35.587336    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:38.777727 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:38.777694    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:38.828025 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:38.827992    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:45.763505 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:45.763468    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:45.818027 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:45.817991    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:46:45.901853 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:46:45.901818    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:06.867026 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:06.866989    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:10.669066 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:10.669029    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:13.450424 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:13.450387    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:13.919031 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:13.918998    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:15.208433 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:15.208401    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:18.053032 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:18.052998    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:18.651609 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:18.651567    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:19.496821 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:19.496788    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:19.601613 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:19.601583    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:22.568506 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:22.568470    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:23.264981 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:23.264924    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:23.363250 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:23.363217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:26.857202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:26.857165    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:27.064272 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:27.064235    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:27.178203 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:27.178170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:30.499065 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:30.499024    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:30.610167 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:30.610134    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:36.872730 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:36.872686    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"]
Jul 10 16:47:36.877967 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:36.877922    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:36.881073 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:36.881048    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 16:47:36.881073 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:36.881068    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8z57\""
Jul 10 16:47:36.881251 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:36.881079    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 16:47:36.889058 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:36.889035    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"]
Jul 10 16:47:36.980036 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:36.979999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e68ab21-d5c1-4a62-9524-da944e58061b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" (UID: \"1e68ab21-d5c1-4a62-9524-da944e58061b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:36.980238 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:36.980153    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjh48\" (UniqueName: \"kubernetes.io/projected/1e68ab21-d5c1-4a62-9524-da944e58061b-kube-api-access-mjh48\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" (UID: \"1e68ab21-d5c1-4a62-9524-da944e58061b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:37.081303 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.081263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjh48\" (UniqueName: \"kubernetes.io/projected/1e68ab21-d5c1-4a62-9524-da944e58061b-kube-api-access-mjh48\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" (UID: \"1e68ab21-d5c1-4a62-9524-da944e58061b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:37.081459 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.081317    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e68ab21-d5c1-4a62-9524-da944e58061b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" (UID: \"1e68ab21-d5c1-4a62-9524-da944e58061b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:37.081663 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.081648    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e68ab21-d5c1-4a62-9524-da944e58061b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" (UID: \"1e68ab21-d5c1-4a62-9524-da944e58061b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:37.090604 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.090574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjh48\" (UniqueName: \"kubernetes.io/projected/1e68ab21-d5c1-4a62-9524-da944e58061b-kube-api-access-mjh48\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" (UID: \"1e68ab21-d5c1-4a62-9524-da944e58061b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:37.189528 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.189494    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:37.324279 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.324248    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"]
Jul 10 16:47:37.327727 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:47:37.327693    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e68ab21_d5c1_4a62_9524_da944e58061b.slice/crio-96190463ae0e7179691ed65e3c2be3c1bd6f7107b89c8b67ba0cdd73a78bff69 WatchSource:0}: Error finding container 96190463ae0e7179691ed65e3c2be3c1bd6f7107b89c8b67ba0cdd73a78bff69: Status 404 returned error can't find the container with id 96190463ae0e7179691ed65e3c2be3c1bd6f7107b89c8b67ba0cdd73a78bff69
Jul 10 16:47:37.330192 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.330176    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 16:47:37.530898 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.530812    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46" event={"ID":"1e68ab21-d5c1-4a62-9524-da944e58061b","Type":"ContainerStarted","Data":"96190463ae0e7179691ed65e3c2be3c1bd6f7107b89c8b67ba0cdd73a78bff69"}
Jul 10 16:47:37.597214 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.597179    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"]
Jul 10 16:47:37.604202 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.604175    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"]
Jul 10 16:47:37.622418 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.622388    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"]
Jul 10 16:47:37.627225 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.627204    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:37.638857 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.638830    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"]
Jul 10 16:47:37.687428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.687386    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e495f009-2712-4e13-b26a-0111f00311a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7b69p\" (UID: \"e495f009-2712-4e13-b26a-0111f00311a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:37.687610 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.687554    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk59x\" (UniqueName: \"kubernetes.io/projected/e495f009-2712-4e13-b26a-0111f00311a2-kube-api-access-hk59x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7b69p\" (UID: \"e495f009-2712-4e13-b26a-0111f00311a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:37.788368 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.788264    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk59x\" (UniqueName: \"kubernetes.io/projected/e495f009-2712-4e13-b26a-0111f00311a2-kube-api-access-hk59x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7b69p\" (UID: \"e495f009-2712-4e13-b26a-0111f00311a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:37.788368 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.788337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e495f009-2712-4e13-b26a-0111f00311a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7b69p\" (UID: \"e495f009-2712-4e13-b26a-0111f00311a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:37.788738 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.788719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e495f009-2712-4e13-b26a-0111f00311a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7b69p\" (UID: \"e495f009-2712-4e13-b26a-0111f00311a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:37.797299 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.797274    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk59x\" (UniqueName: \"kubernetes.io/projected/e495f009-2712-4e13-b26a-0111f00311a2-kube-api-access-hk59x\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-7b69p\" (UID: \"e495f009-2712-4e13-b26a-0111f00311a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:37.939150 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:37.939101    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:38.264402 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:38.264371    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"]
Jul 10 16:47:38.371854 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:47:38.371824    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode495f009_2712_4e13_b26a_0111f00311a2.slice/crio-a8ac28b3e2c94f58775e1e1eb5808d303a22420a0181392bfa17e43c7ce89a1a WatchSource:0}: Error finding container a8ac28b3e2c94f58775e1e1eb5808d303a22420a0181392bfa17e43c7ce89a1a: Status 404 returned error can't find the container with id a8ac28b3e2c94f58775e1e1eb5808d303a22420a0181392bfa17e43c7ce89a1a
Jul 10 16:47:38.538688 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:38.538652    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p" event={"ID":"e495f009-2712-4e13-b26a-0111f00311a2","Type":"ContainerStarted","Data":"a8ac28b3e2c94f58775e1e1eb5808d303a22420a0181392bfa17e43c7ce89a1a"}
Jul 10 16:47:39.108145 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:39.108114    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:39.233047 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:39.233002    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:41.591305 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:41.591264    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:41.740746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:41.740704    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:42.561662 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.561548    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" containerName="manager" containerID="cri-o://cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d" gracePeriod=2
Jul 10 16:47:42.563219 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.563189    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p" event={"ID":"e495f009-2712-4e13-b26a-0111f00311a2","Type":"ContainerStarted","Data":"4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91"}
Jul 10 16:47:42.563388 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.563288    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:42.564606 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:47:42.564580    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" is forbidden: User \"system:node:ip-10-0-137-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-50.ec2.internal' and this object" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:42.590102 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:47:42.590074    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" is forbidden: User \"system:node:ip-10-0-137-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-50.ec2.internal' and this object" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:42.802108 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.802083    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:42.804841 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:47:42.804812    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" is forbidden: User \"system:node:ip-10-0-137-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-50.ec2.internal' and this object" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:42.936873 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.936839    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e68ab21-d5c1-4a62-9524-da944e58061b-extensions-socket-volume\") pod \"1e68ab21-d5c1-4a62-9524-da944e58061b\" (UID: \"1e68ab21-d5c1-4a62-9524-da944e58061b\") "
Jul 10 16:47:42.937134 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.936976    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjh48\" (UniqueName: \"kubernetes.io/projected/1e68ab21-d5c1-4a62-9524-da944e58061b-kube-api-access-mjh48\") pod \"1e68ab21-d5c1-4a62-9524-da944e58061b\" (UID: \"1e68ab21-d5c1-4a62-9524-da944e58061b\") "
Jul 10 16:47:42.937134 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.937068    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e68ab21-d5c1-4a62-9524-da944e58061b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1e68ab21-d5c1-4a62-9524-da944e58061b" (UID: "1e68ab21-d5c1-4a62-9524-da944e58061b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 16:47:42.937298 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.937280    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e68ab21-d5c1-4a62-9524-da944e58061b-extensions-socket-volume\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:47:42.939001 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:42.938977    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e68ab21-d5c1-4a62-9524-da944e58061b-kube-api-access-mjh48" (OuterVolumeSpecName: "kube-api-access-mjh48") pod "1e68ab21-d5c1-4a62-9524-da944e58061b" (UID: "1e68ab21-d5c1-4a62-9524-da944e58061b"). InnerVolumeSpecName "kube-api-access-mjh48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:47:43.037918 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:43.037884    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjh48\" (UniqueName: \"kubernetes.io/projected/1e68ab21-d5c1-4a62-9524-da944e58061b-kube-api-access-mjh48\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:47:43.569043 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:43.569007    2574 generic.go:356] "Generic (PLEG): container finished" podID="1e68ab21-d5c1-4a62-9524-da944e58061b" containerID="cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d" exitCode=2
Jul 10 16:47:43.569238 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:43.569049    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:43.569238 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:43.569105    2574 scope.go:117] "RemoveContainer" containerID="cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d"
Jul 10 16:47:43.572066 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:47:43.572040    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" is forbidden: User \"system:node:ip-10-0-137-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-50.ec2.internal' and this object" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:43.578005 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:43.577984    2574 scope.go:117] "RemoveContainer" containerID="cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d"
Jul 10 16:47:43.578306 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:47:43.578288    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d\": container with ID starting with cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d not found: ID does not exist" containerID="cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d"
Jul 10 16:47:43.578364 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:43.578315    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d"} err="failed to get container status \"cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d\": rpc error: code = NotFound desc = could not find container \"cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d\": container with ID starting with cbba8221fe3275ada33a2f0de65064870e19cdaeab22dd556c9fcb9b31f1f24d not found: ID does not exist"
Jul 10 16:47:43.580069 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:47:43.580048    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-ssc46\" is forbidden: User \"system:node:ip-10-0-137-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-50.ec2.internal' and this object" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-ssc46"
Jul 10 16:47:43.866781 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:43.866750    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" path="/var/lib/kubelet/pods/1e68ab21-d5c1-4a62-9524-da944e58061b/volumes"
Jul 10 16:47:44.415410 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:44.415372    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:44.547821 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:44.547784    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:47.977039 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:47.977008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:48.081261 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:48.081216    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:53.572068 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:53.572040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:47:53.595259 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:53.595196    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p" podStartSLOduration=12.658427502 podStartE2EDuration="16.595174114s" totalImagesPullingTime="3.936746612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:47:42.587743608 +0000 UTC m=+683.187919274" watchObservedRunningTime="2026-07-10 16:47:53.595174114 +0000 UTC m=+694.195349769"
Jul 10 16:47:54.838759 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:54.838722    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:54.939945 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:54.939894    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:56.856734 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:56.856683    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:56.956867 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:56.956836    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:59.470217 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:59.470176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:47:59.570925 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:47:59.570887    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:02.679225 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:02.679191    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:02.871223 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:02.871182    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:06.270086 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:06.270035    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:06.448577 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:06.448536    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:09.969298 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:09.969258    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:10.089094 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:10.089061    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:11.591150 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.591122    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"]
Jul 10 16:48:11.591572 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.591308    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p" podUID="e495f009-2712-4e13-b26a-0111f00311a2" containerName="manager" containerID="cri-o://4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91" gracePeriod=10
Jul 10 16:48:11.848249 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.848184    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:48:11.879085 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.879056    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk59x\" (UniqueName: \"kubernetes.io/projected/e495f009-2712-4e13-b26a-0111f00311a2-kube-api-access-hk59x\") pod \"e495f009-2712-4e13-b26a-0111f00311a2\" (UID: \"e495f009-2712-4e13-b26a-0111f00311a2\") "
Jul 10 16:48:11.879301 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.879120    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e495f009-2712-4e13-b26a-0111f00311a2-extensions-socket-volume\") pod \"e495f009-2712-4e13-b26a-0111f00311a2\" (UID: \"e495f009-2712-4e13-b26a-0111f00311a2\") "
Jul 10 16:48:11.879767 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.879740    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e495f009-2712-4e13-b26a-0111f00311a2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e495f009-2712-4e13-b26a-0111f00311a2" (UID: "e495f009-2712-4e13-b26a-0111f00311a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 16:48:11.881456 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.881423    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e495f009-2712-4e13-b26a-0111f00311a2-kube-api-access-hk59x" (OuterVolumeSpecName: "kube-api-access-hk59x") pod "e495f009-2712-4e13-b26a-0111f00311a2" (UID: "e495f009-2712-4e13-b26a-0111f00311a2"). InnerVolumeSpecName "kube-api-access-hk59x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:48:11.980096 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.980053    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk59x\" (UniqueName: \"kubernetes.io/projected/e495f009-2712-4e13-b26a-0111f00311a2-kube-api-access-hk59x\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:48:11.980096 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:11.980088    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e495f009-2712-4e13-b26a-0111f00311a2-extensions-socket-volume\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:48:12.704104 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.704066    2574 generic.go:356] "Generic (PLEG): container finished" podID="e495f009-2712-4e13-b26a-0111f00311a2" containerID="4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91" exitCode=0
Jul 10 16:48:12.704597 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.704116    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"
Jul 10 16:48:12.704597 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.704157    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p" event={"ID":"e495f009-2712-4e13-b26a-0111f00311a2","Type":"ContainerDied","Data":"4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91"}
Jul 10 16:48:12.704597 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.704225    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p" event={"ID":"e495f009-2712-4e13-b26a-0111f00311a2","Type":"ContainerDied","Data":"a8ac28b3e2c94f58775e1e1eb5808d303a22420a0181392bfa17e43c7ce89a1a"}
Jul 10 16:48:12.704597 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.704260    2574 scope.go:117] "RemoveContainer" containerID="4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91"
Jul 10 16:48:12.713817 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.713799    2574 scope.go:117] "RemoveContainer" containerID="4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91"
Jul 10 16:48:12.714086 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:48:12.714067    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91\": container with ID starting with 4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91 not found: ID does not exist" containerID="4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91"
Jul 10 16:48:12.714155 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.714094    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91"} err="failed to get container status \"4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91\": rpc error: code = NotFound desc = could not find container \"4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91\": container with ID starting with 4ed6ddd4f1b02ecef32ff058b91a590386331b90beabde33f9194f2c81f4de91 not found: ID does not exist"
Jul 10 16:48:12.726957 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.726918    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"]
Jul 10 16:48:12.732119 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:12.732098    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-7b69p"]
Jul 10 16:48:13.867190 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:13.867158    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e495f009-2712-4e13-b26a-0111f00311a2" path="/var/lib/kubelet/pods/e495f009-2712-4e13-b26a-0111f00311a2/volumes"
Jul 10 16:48:16.081010 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:16.080975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:16.140970 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:16.140911    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:16.260444 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:16.260415    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:16.330386 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:16.330358    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:31.310061 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:31.310023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:31.465465 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:31.465433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:32.226218 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.226178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:32.229746 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.229721    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"]
Jul 10 16:48:32.230079 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.230068    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" containerName="manager"
Jul 10 16:48:32.230129 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.230081    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" containerName="manager"
Jul 10 16:48:32.230129 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.230100    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e495f009-2712-4e13-b26a-0111f00311a2" containerName="manager"
Jul 10 16:48:32.230129 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.230105    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e495f009-2712-4e13-b26a-0111f00311a2" containerName="manager"
Jul 10 16:48:32.230224 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.230164    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e495f009-2712-4e13-b26a-0111f00311a2" containerName="manager"
Jul 10 16:48:32.230224 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.230176    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e68ab21-d5c1-4a62-9524-da944e58061b" containerName="manager"
Jul 10 16:48:32.234623 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.234607    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:32.237708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.237689    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 16:48:32.237875 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.237853    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 16:48:32.237875 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.237875    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pzmp4\""
Jul 10 16:48:32.239320 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.239303    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 16:48:32.243194 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.243173    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"]
Jul 10 16:48:32.319959 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.319913    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"]
Jul 10 16:48:32.336002 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.335971    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:32.356669 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.356641    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wlp8\" (UniqueName: \"kubernetes.io/projected/58b41860-d976-4d4c-85b4-4823ee1ce28b-kube-api-access-9wlp8\") pod \"limitador-limitador-64c94fd64f-zjq8r\" (UID: \"58b41860-d976-4d4c-85b4-4823ee1ce28b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:32.356818 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.356681    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58b41860-d976-4d4c-85b4-4823ee1ce28b-config-file\") pod \"limitador-limitador-64c94fd64f-zjq8r\" (UID: \"58b41860-d976-4d4c-85b4-4823ee1ce28b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:32.394256 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.394222    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:32.457470 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.457439    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58b41860-d976-4d4c-85b4-4823ee1ce28b-config-file\") pod \"limitador-limitador-64c94fd64f-zjq8r\" (UID: \"58b41860-d976-4d4c-85b4-4823ee1ce28b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:32.457619 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.457534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wlp8\" (UniqueName: \"kubernetes.io/projected/58b41860-d976-4d4c-85b4-4823ee1ce28b-kube-api-access-9wlp8\") pod \"limitador-limitador-64c94fd64f-zjq8r\" (UID: \"58b41860-d976-4d4c-85b4-4823ee1ce28b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:32.458090 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.458070    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58b41860-d976-4d4c-85b4-4823ee1ce28b-config-file\") pod \"limitador-limitador-64c94fd64f-zjq8r\" (UID: \"58b41860-d976-4d4c-85b4-4823ee1ce28b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:32.466436 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.466412    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wlp8\" (UniqueName: \"kubernetes.io/projected/58b41860-d976-4d4c-85b4-4823ee1ce28b-kube-api-access-9wlp8\") pod \"limitador-limitador-64c94fd64f-zjq8r\" (UID: \"58b41860-d976-4d4c-85b4-4823ee1ce28b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:32.545577 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.545499    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:32.677838 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.677804    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"]
Jul 10 16:48:32.681729 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:48:32.681700    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b41860_d976_4d4c_85b4_4823ee1ce28b.slice/crio-18306aaba3e33478b604535633f215b86ef59c1b582db56c12c6f2e0808ee0a1 WatchSource:0}: Error finding container 18306aaba3e33478b604535633f215b86ef59c1b582db56c12c6f2e0808ee0a1: Status 404 returned error can't find the container with id 18306aaba3e33478b604535633f215b86ef59c1b582db56c12c6f2e0808ee0a1
Jul 10 16:48:32.795065 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:32.795030    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r" event={"ID":"58b41860-d976-4d4c-85b4-4823ee1ce28b","Type":"ContainerStarted","Data":"18306aaba3e33478b604535633f215b86ef59c1b582db56c12c6f2e0808ee0a1"}
Jul 10 16:48:33.065412 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.065375    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-69jtm"]
Jul 10 16:48:33.070287 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.070266    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-69jtm"
Jul 10 16:48:33.073415 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.073392    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xzc5g\""
Jul 10 16:48:33.075572 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.075552    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-69jtm"]
Jul 10 16:48:33.099314 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.099287    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:33.162523 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.162488    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg5xc\" (UniqueName: \"kubernetes.io/projected/533de781-2ee9-4846-bcb1-8bbca945710e-kube-api-access-hg5xc\") pod \"authorino-58cd955675-69jtm\" (UID: \"533de781-2ee9-4846-bcb1-8bbca945710e\") " pod="kuadrant-system/authorino-58cd955675-69jtm"
Jul 10 16:48:33.177755 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.177718    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:33.262955 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.262899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg5xc\" (UniqueName: \"kubernetes.io/projected/533de781-2ee9-4846-bcb1-8bbca945710e-kube-api-access-hg5xc\") pod \"authorino-58cd955675-69jtm\" (UID: \"533de781-2ee9-4846-bcb1-8bbca945710e\") " pod="kuadrant-system/authorino-58cd955675-69jtm"
Jul 10 16:48:33.271779 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.271736    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg5xc\" (UniqueName: \"kubernetes.io/projected/533de781-2ee9-4846-bcb1-8bbca945710e-kube-api-access-hg5xc\") pod \"authorino-58cd955675-69jtm\" (UID: \"533de781-2ee9-4846-bcb1-8bbca945710e\") " pod="kuadrant-system/authorino-58cd955675-69jtm"
Jul 10 16:48:33.380906 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.380832    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-69jtm"
Jul 10 16:48:33.517276 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.517233    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-69jtm"]
Jul 10 16:48:33.520087 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:48:33.520056    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod533de781_2ee9_4846_bcb1_8bbca945710e.slice/crio-b48300585fc7416a9f531f42e18a99b4bd6c09a8441d5d9520d83d86ae4355e6 WatchSource:0}: Error finding container b48300585fc7416a9f531f42e18a99b4bd6c09a8441d5d9520d83d86ae4355e6: Status 404 returned error can't find the container with id b48300585fc7416a9f531f42e18a99b4bd6c09a8441d5d9520d83d86ae4355e6
Jul 10 16:48:33.804572 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:33.804526    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-69jtm" event={"ID":"533de781-2ee9-4846-bcb1-8bbca945710e","Type":"ContainerStarted","Data":"b48300585fc7416a9f531f42e18a99b4bd6c09a8441d5d9520d83d86ae4355e6"}
Jul 10 16:48:35.509825 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:35.509792    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:37.828821 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:37.828783    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-69jtm" event={"ID":"533de781-2ee9-4846-bcb1-8bbca945710e","Type":"ContainerStarted","Data":"81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c"}
Jul 10 16:48:37.830272 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:37.830240    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r" event={"ID":"58b41860-d976-4d4c-85b4-4823ee1ce28b","Type":"ContainerStarted","Data":"9d2c5d2340fb9cb950b1caced4aa452b2466c81d08a305772553ebcdbb9dbd30"}
Jul 10 16:48:37.830412 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:37.830320    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:37.845053 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:37.845004    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-69jtm" podStartSLOduration=1.009713225 podStartE2EDuration="4.844990676s" totalImagesPullingTime="3.835277451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:48:37.84431138 +0000 UTC m=+738.444487036" watchObservedRunningTime="2026-07-10 16:48:37.844990676 +0000 UTC m=+738.445166330"
Jul 10 16:48:37.864160 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:37.864106    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r" podStartSLOduration=1.23571997 podStartE2EDuration="5.864088206s" totalImagesPullingTime="4.628368236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:48:37.862731502 +0000 UTC m=+738.462907158" watchObservedRunningTime="2026-07-10 16:48:37.864088206 +0000 UTC m=+738.464263862"
Jul 10 16:48:38.349130 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:38.349096    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-69jtm"]
Jul 10 16:48:39.840374 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:39.840322    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-69jtm" podUID="533de781-2ee9-4846-bcb1-8bbca945710e" containerName="authorino" containerID="cri-o://81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c" gracePeriod=30
Jul 10 16:48:40.093073 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.093013    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-69jtm"
Jul 10 16:48:40.236384 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.236340    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg5xc\" (UniqueName: \"kubernetes.io/projected/533de781-2ee9-4846-bcb1-8bbca945710e-kube-api-access-hg5xc\") pod \"533de781-2ee9-4846-bcb1-8bbca945710e\" (UID: \"533de781-2ee9-4846-bcb1-8bbca945710e\") "
Jul 10 16:48:40.238359 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.238326    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533de781-2ee9-4846-bcb1-8bbca945710e-kube-api-access-hg5xc" (OuterVolumeSpecName: "kube-api-access-hg5xc") pod "533de781-2ee9-4846-bcb1-8bbca945710e" (UID: "533de781-2ee9-4846-bcb1-8bbca945710e"). InnerVolumeSpecName "kube-api-access-hg5xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:48:40.337127 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.337095    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg5xc\" (UniqueName: \"kubernetes.io/projected/533de781-2ee9-4846-bcb1-8bbca945710e-kube-api-access-hg5xc\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:48:40.846260 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.846224    2574 generic.go:356] "Generic (PLEG): container finished" podID="533de781-2ee9-4846-bcb1-8bbca945710e" containerID="81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c" exitCode=0
Jul 10 16:48:40.846796 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.846269    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-69jtm"
Jul 10 16:48:40.846796 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.846278    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-69jtm" event={"ID":"533de781-2ee9-4846-bcb1-8bbca945710e","Type":"ContainerDied","Data":"81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c"}
Jul 10 16:48:40.846796 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.846319    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-69jtm" event={"ID":"533de781-2ee9-4846-bcb1-8bbca945710e","Type":"ContainerDied","Data":"b48300585fc7416a9f531f42e18a99b4bd6c09a8441d5d9520d83d86ae4355e6"}
Jul 10 16:48:40.846796 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.846341    2574 scope.go:117] "RemoveContainer" containerID="81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c"
Jul 10 16:48:40.855726 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.855712    2574 scope.go:117] "RemoveContainer" containerID="81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c"
Jul 10 16:48:40.856000 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:48:40.855912    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c\": container with ID starting with 81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c not found: ID does not exist" containerID="81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c"
Jul 10 16:48:40.856078 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.856014    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c"} err="failed to get container status \"81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c\": rpc error: code = NotFound desc = could not find container \"81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c\": container with ID starting with 81ff27afa5a9848452cda10251fe27ded2a4f376efdd96a4dcf4af7560ee137c not found: ID does not exist"
Jul 10 16:48:40.867948 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.867913    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-69jtm"]
Jul 10 16:48:40.875307 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:40.875287    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-69jtm"]
Jul 10 16:48:41.866873 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:41.866822    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="533de781-2ee9-4846-bcb1-8bbca945710e" path="/var/lib/kubelet/pods/533de781-2ee9-4846-bcb1-8bbca945710e/volumes"
Jul 10 16:48:48.836572 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:48.836538    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:49.345877 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.345840    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"]
Jul 10 16:48:49.346092 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.346069    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r" podUID="58b41860-d976-4d4c-85b4-4823ee1ce28b" containerName="limitador" containerID="cri-o://9d2c5d2340fb9cb950b1caced4aa452b2466c81d08a305772553ebcdbb9dbd30" gracePeriod=30
Jul 10 16:48:49.893240 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.893207    2574 generic.go:356] "Generic (PLEG): container finished" podID="58b41860-d976-4d4c-85b4-4823ee1ce28b" containerID="9d2c5d2340fb9cb950b1caced4aa452b2466c81d08a305772553ebcdbb9dbd30" exitCode=0
Jul 10 16:48:49.893570 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.893254    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r" event={"ID":"58b41860-d976-4d4c-85b4-4823ee1ce28b","Type":"ContainerDied","Data":"9d2c5d2340fb9cb950b1caced4aa452b2466c81d08a305772553ebcdbb9dbd30"}
Jul 10 16:48:49.893570 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.893300    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r" event={"ID":"58b41860-d976-4d4c-85b4-4823ee1ce28b","Type":"ContainerDied","Data":"18306aaba3e33478b604535633f215b86ef59c1b582db56c12c6f2e0808ee0a1"}
Jul 10 16:48:49.893570 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.893318    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18306aaba3e33478b604535633f215b86ef59c1b582db56c12c6f2e0808ee0a1"
Jul 10 16:48:49.899002 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.898976    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:49.907234 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.907176    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58b41860-d976-4d4c-85b4-4823ee1ce28b-config-file\") pod \"58b41860-d976-4d4c-85b4-4823ee1ce28b\" (UID: \"58b41860-d976-4d4c-85b4-4823ee1ce28b\") "
Jul 10 16:48:49.907234 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.907208    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wlp8\" (UniqueName: \"kubernetes.io/projected/58b41860-d976-4d4c-85b4-4823ee1ce28b-kube-api-access-9wlp8\") pod \"58b41860-d976-4d4c-85b4-4823ee1ce28b\" (UID: \"58b41860-d976-4d4c-85b4-4823ee1ce28b\") "
Jul 10 16:48:49.907578 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.907554    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58b41860-d976-4d4c-85b4-4823ee1ce28b-config-file" (OuterVolumeSpecName: "config-file") pod "58b41860-d976-4d4c-85b4-4823ee1ce28b" (UID: "58b41860-d976-4d4c-85b4-4823ee1ce28b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 16:48:49.909232 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:49.909214    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58b41860-d976-4d4c-85b4-4823ee1ce28b-kube-api-access-9wlp8" (OuterVolumeSpecName: "kube-api-access-9wlp8") pod "58b41860-d976-4d4c-85b4-4823ee1ce28b" (UID: "58b41860-d976-4d4c-85b4-4823ee1ce28b"). InnerVolumeSpecName "kube-api-access-9wlp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:48:50.008564 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:50.008536    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/58b41860-d976-4d4c-85b4-4823ee1ce28b-config-file\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:48:50.008564 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:50.008560    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wlp8\" (UniqueName: \"kubernetes.io/projected/58b41860-d976-4d4c-85b4-4823ee1ce28b-kube-api-access-9wlp8\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:48:50.898404 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:50.898372    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"
Jul 10 16:48:50.919742 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:50.919712    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"]
Jul 10 16:48:50.923452 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:50.923427    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zjq8r"]
Jul 10 16:48:51.866975 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:51.866942    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58b41860-d976-4d4c-85b4-4823ee1ce28b" path="/var/lib/kubelet/pods/58b41860-d976-4d4c-85b4-4823ee1ce28b/volumes"
Jul 10 16:48:53.852009 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:53.851971    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:53.955249 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:53.955217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:54.344295 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.344264    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"]
Jul 10 16:48:54.344627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.344613    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533de781-2ee9-4846-bcb1-8bbca945710e" containerName="authorino"
Jul 10 16:48:54.344682 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.344629    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="533de781-2ee9-4846-bcb1-8bbca945710e" containerName="authorino"
Jul 10 16:48:54.344682 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.344654    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b41860-d976-4d4c-85b4-4823ee1ce28b" containerName="limitador"
Jul 10 16:48:54.344682 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.344659    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b41860-d976-4d4c-85b4-4823ee1ce28b" containerName="limitador"
Jul 10 16:48:54.344778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.344713    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="533de781-2ee9-4846-bcb1-8bbca945710e" containerName="authorino"
Jul 10 16:48:54.344778 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.344724    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b41860-d976-4d4c-85b4-4823ee1ce28b" containerName="limitador"
Jul 10 16:48:54.350897 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.350875    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:48:54.355264 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.355239    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 16:48:54.355448 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.355237    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vn9zj\""
Jul 10 16:48:54.355519 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.355242    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 10 16:48:54.355574 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.355277    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 16:48:54.356086 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.356062    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"]
Jul 10 16:48:54.376984 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.376949    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:48:54.441195 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.441160    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gf69\" (UniqueName: \"kubernetes.io/projected/f1e0075a-da8b-43f5-bece-7ec06613a5cd-kube-api-access-7gf69\") pod \"postgres-69fb4594cf-6vrmz\" (UID: \"f1e0075a-da8b-43f5-bece-7ec06613a5cd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:48:54.441379 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.441254    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1e0075a-da8b-43f5-bece-7ec06613a5cd-data\") pod \"postgres-69fb4594cf-6vrmz\" (UID: \"f1e0075a-da8b-43f5-bece-7ec06613a5cd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:48:54.541832 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.541787    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1e0075a-da8b-43f5-bece-7ec06613a5cd-data\") pod \"postgres-69fb4594cf-6vrmz\" (UID: \"f1e0075a-da8b-43f5-bece-7ec06613a5cd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:48:54.542041 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.541868    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gf69\" (UniqueName: \"kubernetes.io/projected/f1e0075a-da8b-43f5-bece-7ec06613a5cd-kube-api-access-7gf69\") pod \"postgres-69fb4594cf-6vrmz\" (UID: \"f1e0075a-da8b-43f5-bece-7ec06613a5cd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:48:54.542203 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.542181    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f1e0075a-da8b-43f5-bece-7ec06613a5cd-data\") pod \"postgres-69fb4594cf-6vrmz\" (UID: \"f1e0075a-da8b-43f5-bece-7ec06613a5cd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:48:54.553174 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.553146    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gf69\" (UniqueName: \"kubernetes.io/projected/f1e0075a-da8b-43f5-bece-7ec06613a5cd-kube-api-access-7gf69\") pod \"postgres-69fb4594cf-6vrmz\" (UID: \"f1e0075a-da8b-43f5-bece-7ec06613a5cd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:48:54.662761 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.662727    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:48:54.828239 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.828214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"]
Jul 10 16:48:54.830702 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:48:54.830678    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e0075a_da8b_43f5_bece_7ec06613a5cd.slice/crio-44cf9e6585bab5508e4ce7ff7e02378c39b5dc205043ba52822f46f756de96a3 WatchSource:0}: Error finding container 44cf9e6585bab5508e4ce7ff7e02378c39b5dc205043ba52822f46f756de96a3: Status 404 returned error can't find the container with id 44cf9e6585bab5508e4ce7ff7e02378c39b5dc205043ba52822f46f756de96a3
Jul 10 16:48:54.917848 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:48:54.917769    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz" event={"ID":"f1e0075a-da8b-43f5-bece-7ec06613a5cd","Type":"ContainerStarted","Data":"44cf9e6585bab5508e4ce7ff7e02378c39b5dc205043ba52822f46f756de96a3"}
Jul 10 16:49:00.952526 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:00.952486    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz" event={"ID":"f1e0075a-da8b-43f5-bece-7ec06613a5cd","Type":"ContainerStarted","Data":"f4f02a279eaca154721ffa39970efe3481e1c671ab712f472d635091e238de5b"}
Jul 10 16:49:00.953009 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:00.952612    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:49:00.970261 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:00.970212    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz" podStartSLOduration=1.87674954 podStartE2EDuration="6.970196838s" totalImagesPullingTime="5.093447298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:49:00.967513101 +0000 UTC m=+761.567688758" watchObservedRunningTime="2026-07-10 16:49:00.970196838 +0000 UTC m=+761.570372492"
Jul 10 16:49:06.989358 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:06.989324    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-6vrmz"
Jul 10 16:49:07.318000 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.317898    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:07.554627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.554594    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6tc7x"]
Jul 10 16:49:07.558149 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.558133    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6tc7x"
Jul 10 16:49:07.561055 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.561029    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 16:49:07.561204 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.561159    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 16:49:07.562409 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.562394    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xzc5g\""
Jul 10 16:49:07.566116 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.566092    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6tc7x"]
Jul 10 16:49:07.582708 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.582646    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:07.642257 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.642217    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:07.659310 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.659282    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp7dq\" (UniqueName: \"kubernetes.io/projected/bc6b4bfe-81c9-4456-848c-2e160ac424cc-kube-api-access-zp7dq\") pod \"authorino-5d4b67c446-6tc7x\" (UID: \"bc6b4bfe-81c9-4456-848c-2e160ac424cc\") " pod="kuadrant-system/authorino-5d4b67c446-6tc7x"
Jul 10 16:49:07.759762 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.759730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp7dq\" (UniqueName: \"kubernetes.io/projected/bc6b4bfe-81c9-4456-848c-2e160ac424cc-kube-api-access-zp7dq\") pod \"authorino-5d4b67c446-6tc7x\" (UID: \"bc6b4bfe-81c9-4456-848c-2e160ac424cc\") " pod="kuadrant-system/authorino-5d4b67c446-6tc7x"
Jul 10 16:49:07.767823 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.767797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp7dq\" (UniqueName: \"kubernetes.io/projected/bc6b4bfe-81c9-4456-848c-2e160ac424cc-kube-api-access-zp7dq\") pod \"authorino-5d4b67c446-6tc7x\" (UID: \"bc6b4bfe-81c9-4456-848c-2e160ac424cc\") " pod="kuadrant-system/authorino-5d4b67c446-6tc7x"
Jul 10 16:49:07.801118 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.801085    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6tc7x"]
Jul 10 16:49:07.801405 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.801388    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6tc7x"
Jul 10 16:49:07.829851 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.829812    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bb956f964-cb7r8"]
Jul 10 16:49:07.834419 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.834362    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb956f964-cb7r8"
Jul 10 16:49:07.840428 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.840404    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bb956f964-cb7r8"]
Jul 10 16:49:07.860402 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.860375    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftk5w\" (UniqueName: \"kubernetes.io/projected/051fe967-6e93-4058-a002-8d57c7490008-kube-api-access-ftk5w\") pod \"authorino-bb956f964-cb7r8\" (UID: \"051fe967-6e93-4058-a002-8d57c7490008\") " pod="kuadrant-system/authorino-bb956f964-cb7r8"
Jul 10 16:49:07.918839 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.918812    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bb956f964-cb7r8"]
Jul 10 16:49:07.919142 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:49:07.919121    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ftk5w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-bb956f964-cb7r8" podUID="051fe967-6e93-4058-a002-8d57c7490008"
Jul 10 16:49:07.940029 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.940003    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6tc7x"]
Jul 10 16:49:07.942501 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:49:07.942473    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc6b4bfe_81c9_4456_848c_2e160ac424cc.slice/crio-4475633d4671d6d1a6834466142e3991ea10b391aafbc8b7ab23bc37c3de399d WatchSource:0}: Error finding container 4475633d4671d6d1a6834466142e3991ea10b391aafbc8b7ab23bc37c3de399d: Status 404 returned error can't find the container with id 4475633d4671d6d1a6834466142e3991ea10b391aafbc8b7ab23bc37c3de399d
Jul 10 16:49:07.961534 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.961510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftk5w\" (UniqueName: \"kubernetes.io/projected/051fe967-6e93-4058-a002-8d57c7490008-kube-api-access-ftk5w\") pod \"authorino-bb956f964-cb7r8\" (UID: \"051fe967-6e93-4058-a002-8d57c7490008\") " pod="kuadrant-system/authorino-bb956f964-cb7r8"
Jul 10 16:49:07.971421 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.971395    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftk5w\" (UniqueName: \"kubernetes.io/projected/051fe967-6e93-4058-a002-8d57c7490008-kube-api-access-ftk5w\") pod \"authorino-bb956f964-cb7r8\" (UID: \"051fe967-6e93-4058-a002-8d57c7490008\") " pod="kuadrant-system/authorino-bb956f964-cb7r8"
Jul 10 16:49:07.986273 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.986255    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb956f964-cb7r8"
Jul 10 16:49:07.986377 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.986269    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6tc7x" event={"ID":"bc6b4bfe-81c9-4456-848c-2e160ac424cc","Type":"ContainerStarted","Data":"4475633d4671d6d1a6834466142e3991ea10b391aafbc8b7ab23bc37c3de399d"}
Jul 10 16:49:07.993302 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:07.993282    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb956f964-cb7r8"
Jul 10 16:49:08.062116 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:08.062082    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftk5w\" (UniqueName: \"kubernetes.io/projected/051fe967-6e93-4058-a002-8d57c7490008-kube-api-access-ftk5w\") pod \"051fe967-6e93-4058-a002-8d57c7490008\" (UID: \"051fe967-6e93-4058-a002-8d57c7490008\") "
Jul 10 16:49:08.064147 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:08.064123    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/051fe967-6e93-4058-a002-8d57c7490008-kube-api-access-ftk5w" (OuterVolumeSpecName: "kube-api-access-ftk5w") pod "051fe967-6e93-4058-a002-8d57c7490008" (UID: "051fe967-6e93-4058-a002-8d57c7490008"). InnerVolumeSpecName "kube-api-access-ftk5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:49:08.162739 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:08.162709    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftk5w\" (UniqueName: \"kubernetes.io/projected/051fe967-6e93-4058-a002-8d57c7490008-kube-api-access-ftk5w\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:49:08.992077 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:08.992050    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb956f964-cb7r8"
Jul 10 16:49:08.992258 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:08.992115    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6tc7x" podUID="bc6b4bfe-81c9-4456-848c-2e160ac424cc" containerName="authorino" containerID="cri-o://a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6" gracePeriod=30
Jul 10 16:49:08.992258 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:08.992051    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6tc7x" event={"ID":"bc6b4bfe-81c9-4456-848c-2e160ac424cc","Type":"ContainerStarted","Data":"a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6"}
Jul 10 16:49:09.013289 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.013243    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6tc7x" podStartSLOduration=1.606651262 podStartE2EDuration="2.013226337s" totalImagesPullingTime="406.575075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:49:09.011432155 +0000 UTC m=+769.611607820" watchObservedRunningTime="2026-07-10 16:49:09.013226337 +0000 UTC m=+769.613401992"
Jul 10 16:49:09.036740 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.036676    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bb956f964-cb7r8"]
Jul 10 16:49:09.041378 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.041350    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-bb956f964-cb7r8"]
Jul 10 16:49:09.245947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.245906    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6tc7x"
Jul 10 16:49:09.275707 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.275681    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp7dq\" (UniqueName: \"kubernetes.io/projected/bc6b4bfe-81c9-4456-848c-2e160ac424cc-kube-api-access-zp7dq\") pod \"bc6b4bfe-81c9-4456-848c-2e160ac424cc\" (UID: \"bc6b4bfe-81c9-4456-848c-2e160ac424cc\") "
Jul 10 16:49:09.277690 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.277660    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6b4bfe-81c9-4456-848c-2e160ac424cc-kube-api-access-zp7dq" (OuterVolumeSpecName: "kube-api-access-zp7dq") pod "bc6b4bfe-81c9-4456-848c-2e160ac424cc" (UID: "bc6b4bfe-81c9-4456-848c-2e160ac424cc"). InnerVolumeSpecName "kube-api-access-zp7dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:49:09.376353 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.376278    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp7dq\" (UniqueName: \"kubernetes.io/projected/bc6b4bfe-81c9-4456-848c-2e160ac424cc-kube-api-access-zp7dq\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:49:09.866874 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.866842    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="051fe967-6e93-4058-a002-8d57c7490008" path="/var/lib/kubelet/pods/051fe967-6e93-4058-a002-8d57c7490008/volumes"
Jul 10 16:49:09.996819 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.996786    2574 generic.go:356] "Generic (PLEG): container finished" podID="bc6b4bfe-81c9-4456-848c-2e160ac424cc" containerID="a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6" exitCode=0
Jul 10 16:49:09.997024 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.996827    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6tc7x"
Jul 10 16:49:09.997024 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.996848    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6tc7x" event={"ID":"bc6b4bfe-81c9-4456-848c-2e160ac424cc","Type":"ContainerDied","Data":"a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6"}
Jul 10 16:49:09.997024 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.996891    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6tc7x" event={"ID":"bc6b4bfe-81c9-4456-848c-2e160ac424cc","Type":"ContainerDied","Data":"4475633d4671d6d1a6834466142e3991ea10b391aafbc8b7ab23bc37c3de399d"}
Jul 10 16:49:09.997024 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:09.996911    2574 scope.go:117] "RemoveContainer" containerID="a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6"
Jul 10 16:49:10.005133 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:10.005114    2574 scope.go:117] "RemoveContainer" containerID="a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6"
Jul 10 16:49:10.005378 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:49:10.005359    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6\": container with ID starting with a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6 not found: ID does not exist" containerID="a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6"
Jul 10 16:49:10.005441 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:10.005390    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6"} err="failed to get container status \"a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6\": rpc error: code = NotFound desc = could not find container \"a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6\": container with ID starting with a043199f27852cfaa352a26802cfee296d89650c77f6e63bce607cbc2b6ec6e6 not found: ID does not exist"
Jul 10 16:49:10.017473 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:10.017450    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6tc7x"]
Jul 10 16:49:10.021866 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:10.021836    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6tc7x"]
Jul 10 16:49:11.867585 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:11.867550    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc6b4bfe-81c9-4456-848c-2e160ac424cc" path="/var/lib/kubelet/pods/bc6b4bfe-81c9-4456-848c-2e160ac424cc/volumes"
Jul 10 16:49:13.780027 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.779987    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:13.792274 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.792242    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78f594759f-7sx42"]
Jul 10 16:49:13.792619 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.792606    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc6b4bfe-81c9-4456-848c-2e160ac424cc" containerName="authorino"
Jul 10 16:49:13.792659 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.792620    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc6b4bfe-81c9-4456-848c-2e160ac424cc" containerName="authorino"
Jul 10 16:49:13.792706 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.792687    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc6b4bfe-81c9-4456-848c-2e160ac424cc" containerName="authorino"
Jul 10 16:49:13.796917 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.796898    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:13.799875 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.799851    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 16:49:13.800027 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.799876    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 16:49:13.800027 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.799954    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-njz59\""
Jul 10 16:49:13.807230 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.807205    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78f594759f-7sx42"]
Jul 10 16:49:13.881760 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.881733    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:13.918799 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.918768    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86436393-d332-480d-b305-f353fba3d447-webhook-cert\") pod \"maas-controller-78f594759f-7sx42\" (UID: \"86436393-d332-480d-b305-f353fba3d447\") " pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:13.918987 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.918824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7kzw\" (UniqueName: \"kubernetes.io/projected/86436393-d332-480d-b305-f353fba3d447-kube-api-access-t7kzw\") pod \"maas-controller-78f594759f-7sx42\" (UID: \"86436393-d332-480d-b305-f353fba3d447\") " pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:13.936136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.936102    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:13.972567 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.972535    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4859d9f6-6vzmr"]
Jul 10 16:49:13.975907 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.975888    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:13.986706 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:13.986688    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4859d9f6-6vzmr"]
Jul 10 16:49:14.019594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.019566    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7kzw\" (UniqueName: \"kubernetes.io/projected/86436393-d332-480d-b305-f353fba3d447-kube-api-access-t7kzw\") pod \"maas-controller-78f594759f-7sx42\" (UID: \"86436393-d332-480d-b305-f353fba3d447\") " pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:14.019736 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.019609    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt8mz\" (UniqueName: \"kubernetes.io/projected/e5fbe313-e1be-4a87-91d9-b0e81473312b-kube-api-access-wt8mz\") pod \"maas-controller-d4859d9f6-6vzmr\" (UID: \"e5fbe313-e1be-4a87-91d9-b0e81473312b\") " pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:14.019736 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.019673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5fbe313-e1be-4a87-91d9-b0e81473312b-webhook-cert\") pod \"maas-controller-d4859d9f6-6vzmr\" (UID: \"e5fbe313-e1be-4a87-91d9-b0e81473312b\") " pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:14.019736 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.019720    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86436393-d332-480d-b305-f353fba3d447-webhook-cert\") pod \"maas-controller-78f594759f-7sx42\" (UID: \"86436393-d332-480d-b305-f353fba3d447\") " pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:14.022062 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.022043    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86436393-d332-480d-b305-f353fba3d447-webhook-cert\") pod \"maas-controller-78f594759f-7sx42\" (UID: \"86436393-d332-480d-b305-f353fba3d447\") " pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:14.028915 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.028894    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7kzw\" (UniqueName: \"kubernetes.io/projected/86436393-d332-480d-b305-f353fba3d447-kube-api-access-t7kzw\") pod \"maas-controller-78f594759f-7sx42\" (UID: \"86436393-d332-480d-b305-f353fba3d447\") " pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:14.110216 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.110131    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:14.120513 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.120485    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt8mz\" (UniqueName: \"kubernetes.io/projected/e5fbe313-e1be-4a87-91d9-b0e81473312b-kube-api-access-wt8mz\") pod \"maas-controller-d4859d9f6-6vzmr\" (UID: \"e5fbe313-e1be-4a87-91d9-b0e81473312b\") " pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:14.120638 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.120576    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5fbe313-e1be-4a87-91d9-b0e81473312b-webhook-cert\") pod \"maas-controller-d4859d9f6-6vzmr\" (UID: \"e5fbe313-e1be-4a87-91d9-b0e81473312b\") " pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:14.122871 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.122847    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5fbe313-e1be-4a87-91d9-b0e81473312b-webhook-cert\") pod \"maas-controller-d4859d9f6-6vzmr\" (UID: \"e5fbe313-e1be-4a87-91d9-b0e81473312b\") " pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:14.131828 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.131797    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt8mz\" (UniqueName: \"kubernetes.io/projected/e5fbe313-e1be-4a87-91d9-b0e81473312b-kube-api-access-wt8mz\") pod \"maas-controller-d4859d9f6-6vzmr\" (UID: \"e5fbe313-e1be-4a87-91d9-b0e81473312b\") " pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:14.244841 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.244802    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78f594759f-7sx42"]
Jul 10 16:49:14.248590 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:49:14.248561    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86436393_d332_480d_b305_f353fba3d447.slice/crio-c6bb9d0d04e1e0fcce9829f0039b0aeaa79926c93789584cd0016ce88400a499 WatchSource:0}: Error finding container c6bb9d0d04e1e0fcce9829f0039b0aeaa79926c93789584cd0016ce88400a499: Status 404 returned error can't find the container with id c6bb9d0d04e1e0fcce9829f0039b0aeaa79926c93789584cd0016ce88400a499
Jul 10 16:49:14.286102 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.286076    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:14.419620 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:14.419558    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4859d9f6-6vzmr"]
Jul 10 16:49:14.421845 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:49:14.421820    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fbe313_e1be_4a87_91d9_b0e81473312b.slice/crio-e654a38cf0ecbeb5817472817047c81aee44820a29287fbe4778eb6bfb5b2c56 WatchSource:0}: Error finding container e654a38cf0ecbeb5817472817047c81aee44820a29287fbe4778eb6bfb5b2c56: Status 404 returned error can't find the container with id e654a38cf0ecbeb5817472817047c81aee44820a29287fbe4778eb6bfb5b2c56
Jul 10 16:49:15.025816 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:15.025765    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4859d9f6-6vzmr" event={"ID":"e5fbe313-e1be-4a87-91d9-b0e81473312b","Type":"ContainerStarted","Data":"e654a38cf0ecbeb5817472817047c81aee44820a29287fbe4778eb6bfb5b2c56"}
Jul 10 16:49:15.029304 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:15.029239    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78f594759f-7sx42" event={"ID":"86436393-d332-480d-b305-f353fba3d447","Type":"ContainerStarted","Data":"c6bb9d0d04e1e0fcce9829f0039b0aeaa79926c93789584cd0016ce88400a499"}
Jul 10 16:49:16.715978 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:16.715945    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:16.812896 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:16.812804    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:17.045632 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:17.045596    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78f594759f-7sx42" event={"ID":"86436393-d332-480d-b305-f353fba3d447","Type":"ContainerStarted","Data":"d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6"}
Jul 10 16:49:17.045845 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:17.045746    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:17.047093 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:17.047069    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4859d9f6-6vzmr" event={"ID":"e5fbe313-e1be-4a87-91d9-b0e81473312b","Type":"ContainerStarted","Data":"d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac"}
Jul 10 16:49:17.047220 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:17.047192    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:17.064797 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:17.064697    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78f594759f-7sx42" podStartSLOduration=1.821083624 podStartE2EDuration="4.064681144s" totalImagesPullingTime="2.24359752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:49:17.064132818 +0000 UTC m=+777.664308474" watchObservedRunningTime="2026-07-10 16:49:17.064681144 +0000 UTC m=+777.664856796"
Jul 10 16:49:17.085630 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:17.085576    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d4859d9f6-6vzmr" podStartSLOduration=2.025663196 podStartE2EDuration="4.085561157s" totalImagesPullingTime="2.059897961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:49:17.083602746 +0000 UTC m=+777.683778403" watchObservedRunningTime="2026-07-10 16:49:17.085561157 +0000 UTC m=+777.685736851"
Jul 10 16:49:28.055987 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.055956    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:49:28.056357 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.056023    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:28.118414 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.118382    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78f594759f-7sx42"]
Jul 10 16:49:28.118578 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.118560    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-78f594759f-7sx42" podUID="86436393-d332-480d-b305-f353fba3d447" containerName="manager" containerID="cri-o://d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6" gracePeriod=30
Jul 10 16:49:28.365830 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.365805    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:28.449032 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.448999    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86436393-d332-480d-b305-f353fba3d447-webhook-cert\") pod \"86436393-d332-480d-b305-f353fba3d447\" (UID: \"86436393-d332-480d-b305-f353fba3d447\") "
Jul 10 16:49:28.449199 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.449091    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7kzw\" (UniqueName: \"kubernetes.io/projected/86436393-d332-480d-b305-f353fba3d447-kube-api-access-t7kzw\") pod \"86436393-d332-480d-b305-f353fba3d447\" (UID: \"86436393-d332-480d-b305-f353fba3d447\") "
Jul 10 16:49:28.451244 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.451205    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86436393-d332-480d-b305-f353fba3d447-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "86436393-d332-480d-b305-f353fba3d447" (UID: "86436393-d332-480d-b305-f353fba3d447"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:49:28.451366 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.451300    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86436393-d332-480d-b305-f353fba3d447-kube-api-access-t7kzw" (OuterVolumeSpecName: "kube-api-access-t7kzw") pod "86436393-d332-480d-b305-f353fba3d447" (UID: "86436393-d332-480d-b305-f353fba3d447"). InnerVolumeSpecName "kube-api-access-t7kzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:49:28.550392 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.550357    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7kzw\" (UniqueName: \"kubernetes.io/projected/86436393-d332-480d-b305-f353fba3d447-kube-api-access-t7kzw\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:49:28.550392 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:28.550387    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86436393-d332-480d-b305-f353fba3d447-webhook-cert\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:49:29.105409 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.105374    2574 generic.go:356] "Generic (PLEG): container finished" podID="86436393-d332-480d-b305-f353fba3d447" containerID="d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6" exitCode=0
Jul 10 16:49:29.105871 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.105417    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78f594759f-7sx42"
Jul 10 16:49:29.105871 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.105445    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78f594759f-7sx42" event={"ID":"86436393-d332-480d-b305-f353fba3d447","Type":"ContainerDied","Data":"d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6"}
Jul 10 16:49:29.105871 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.105488    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78f594759f-7sx42" event={"ID":"86436393-d332-480d-b305-f353fba3d447","Type":"ContainerDied","Data":"c6bb9d0d04e1e0fcce9829f0039b0aeaa79926c93789584cd0016ce88400a499"}
Jul 10 16:49:29.105871 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.105511    2574 scope.go:117] "RemoveContainer" containerID="d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6"
Jul 10 16:49:29.114961 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.114944    2574 scope.go:117] "RemoveContainer" containerID="d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6"
Jul 10 16:49:29.115194 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:49:29.115171    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6\": container with ID starting with d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6 not found: ID does not exist" containerID="d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6"
Jul 10 16:49:29.115247 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.115203    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6"} err="failed to get container status \"d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6\": rpc error: code = NotFound desc = could not find container \"d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6\": container with ID starting with d2c16a666dede5d9c29d7b4dc4b18bd8dc4990063e5fc72b6273196fe391bff6 not found: ID does not exist"
Jul 10 16:49:29.128717 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.128693    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78f594759f-7sx42"]
Jul 10 16:49:29.134454 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.134432    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78f594759f-7sx42"]
Jul 10 16:49:29.866601 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:29.866568    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86436393-d332-480d-b305-f353fba3d447" path="/var/lib/kubelet/pods/86436393-d332-480d-b305-f353fba3d447/volumes"
Jul 10 16:49:39.924524 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:39.924486    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:49.243646 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.243592    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:49.341361 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.341311    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:49.748183 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.748148    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:49.812136 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.812104    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"]
Jul 10 16:49:49.812531 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.812517    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86436393-d332-480d-b305-f353fba3d447" containerName="manager"
Jul 10 16:49:49.812578 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.812535    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="86436393-d332-480d-b305-f353fba3d447" containerName="manager"
Jul 10 16:49:49.812627 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.812616    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="86436393-d332-480d-b305-f353fba3d447" containerName="manager"
Jul 10 16:49:49.817093 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.817075    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:49.820376 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.820345    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 16:49:49.820532 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.820512    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rmfx2\""
Jul 10 16:49:49.824671 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.824642    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"]
Jul 10 16:49:49.839130 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.839085    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360ea756-5e3b-4b4b-9031-d8f598531370-openshift-service-ca\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:49.839248 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.839137    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92khk\" (UniqueName: \"kubernetes.io/projected/360ea756-5e3b-4b4b-9031-d8f598531370-kube-api-access-92khk\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:49.839248 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.839212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360ea756-5e3b-4b4b-9031-d8f598531370-maas-api-tls\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:49.940716 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.940680    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360ea756-5e3b-4b4b-9031-d8f598531370-openshift-service-ca\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:49.940716 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.940719    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92khk\" (UniqueName: \"kubernetes.io/projected/360ea756-5e3b-4b4b-9031-d8f598531370-kube-api-access-92khk\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:49.941020 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.940742    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360ea756-5e3b-4b4b-9031-d8f598531370-maas-api-tls\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:49.941020 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:49:49.940844    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 10 16:49:49.941020 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:49:49.940908    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/360ea756-5e3b-4b4b-9031-d8f598531370-maas-api-tls podName:360ea756-5e3b-4b4b-9031-d8f598531370 nodeName:}" failed. No retries permitted until 2026-07-10 16:49:50.440892739 +0000 UTC m=+811.041068375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/360ea756-5e3b-4b4b-9031-d8f598531370-maas-api-tls") pod "maas-api-86cd8d977b-b6879" (UID: "360ea756-5e3b-4b4b-9031-d8f598531370") : secret "maas-api-serving-cert" not found
Jul 10 16:49:49.941462 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.941442    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360ea756-5e3b-4b4b-9031-d8f598531370-openshift-service-ca\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:49.950419 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:49.950393    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92khk\" (UniqueName: \"kubernetes.io/projected/360ea756-5e3b-4b4b-9031-d8f598531370-kube-api-access-92khk\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:50.053613 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.053531    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:50.241205 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.241170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:50.340960 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.340859    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:49:50.358448 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.358413    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pbnsc"]
Jul 10 16:49:50.362283 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.362261    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:50.365415 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.365397    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m4svk\""
Jul 10 16:49:50.365696 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.365681    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 16:49:50.375174 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.375148    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pbnsc"]
Jul 10 16:49:50.379135 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.379111    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k76hq"]
Jul 10 16:49:50.382393 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.382375    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:50.394403 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.394382    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k76hq"]
Jul 10 16:49:50.444809 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.444767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4dbd\" (UniqueName: \"kubernetes.io/projected/60c5fcd8-54d6-4492-a515-47c8a7bc28d8-kube-api-access-x4dbd\") pod \"payload-processing-58f86c7798-k76hq\" (UID: \"60c5fcd8-54d6-4492-a515-47c8a7bc28d8\") " pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:50.445018 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.444829    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360ea756-5e3b-4b4b-9031-d8f598531370-maas-api-tls\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:50.445018 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.444898    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60c5fcd8-54d6-4492-a515-47c8a7bc28d8-plugins-config-volume\") pod \"payload-processing-58f86c7798-k76hq\" (UID: \"60c5fcd8-54d6-4492-a515-47c8a7bc28d8\") " pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:50.445018 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.444959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmffn\" (UniqueName: \"kubernetes.io/projected/7b26622e-d599-415c-8d70-197e2b6868f1-kube-api-access-lmffn\") pod \"payload-pre-processing-7964457696-pbnsc\" (UID: \"7b26622e-d599-415c-8d70-197e2b6868f1\") " pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:50.445127 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.445016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b26622e-d599-415c-8d70-197e2b6868f1-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pbnsc\" (UID: \"7b26622e-d599-415c-8d70-197e2b6868f1\") " pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:50.447286 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.447264    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360ea756-5e3b-4b4b-9031-d8f598531370-maas-api-tls\") pod \"maas-api-86cd8d977b-b6879\" (UID: \"360ea756-5e3b-4b4b-9031-d8f598531370\") " pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:50.546052 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.546016    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmffn\" (UniqueName: \"kubernetes.io/projected/7b26622e-d599-415c-8d70-197e2b6868f1-kube-api-access-lmffn\") pod \"payload-pre-processing-7964457696-pbnsc\" (UID: \"7b26622e-d599-415c-8d70-197e2b6868f1\") " pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:50.546218 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.546089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b26622e-d599-415c-8d70-197e2b6868f1-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pbnsc\" (UID: \"7b26622e-d599-415c-8d70-197e2b6868f1\") " pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:50.546218 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.546131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4dbd\" (UniqueName: \"kubernetes.io/projected/60c5fcd8-54d6-4492-a515-47c8a7bc28d8-kube-api-access-x4dbd\") pod \"payload-processing-58f86c7798-k76hq\" (UID: \"60c5fcd8-54d6-4492-a515-47c8a7bc28d8\") " pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:50.546218 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.546204    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60c5fcd8-54d6-4492-a515-47c8a7bc28d8-plugins-config-volume\") pod \"payload-processing-58f86c7798-k76hq\" (UID: \"60c5fcd8-54d6-4492-a515-47c8a7bc28d8\") " pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:50.547083 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.547061    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b26622e-d599-415c-8d70-197e2b6868f1-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pbnsc\" (UID: \"7b26622e-d599-415c-8d70-197e2b6868f1\") " pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:50.547176 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.547061    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60c5fcd8-54d6-4492-a515-47c8a7bc28d8-plugins-config-volume\") pod \"payload-processing-58f86c7798-k76hq\" (UID: \"60c5fcd8-54d6-4492-a515-47c8a7bc28d8\") " pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:50.554650 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.554622    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmffn\" (UniqueName: \"kubernetes.io/projected/7b26622e-d599-415c-8d70-197e2b6868f1-kube-api-access-lmffn\") pod \"payload-pre-processing-7964457696-pbnsc\" (UID: \"7b26622e-d599-415c-8d70-197e2b6868f1\") " pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:50.554805 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.554784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4dbd\" (UniqueName: \"kubernetes.io/projected/60c5fcd8-54d6-4492-a515-47c8a7bc28d8-kube-api-access-x4dbd\") pod \"payload-processing-58f86c7798-k76hq\" (UID: \"60c5fcd8-54d6-4492-a515-47c8a7bc28d8\") " pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:50.672696 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.672661    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:50.692809 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.692783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:50.729655 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.729105    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:50.831192 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.831167    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pbnsc"]
Jul 10 16:49:50.834066 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:49:50.834037    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b26622e_d599_415c_8d70_197e2b6868f1.slice/crio-d2616f4023916f6991887d1c0c823391234ad80c8d230b68ea155175ad64a2f1 WatchSource:0}: Error finding container d2616f4023916f6991887d1c0c823391234ad80c8d230b68ea155175ad64a2f1: Status 404 returned error can't find the container with id d2616f4023916f6991887d1c0c823391234ad80c8d230b68ea155175ad64a2f1
Jul 10 16:49:50.858511 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.858124    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k76hq"]
Jul 10 16:49:50.860918 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:49:50.860890    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c5fcd8_54d6_4492_a515_47c8a7bc28d8.slice/crio-ccfccb160377789a0198db777010307eedc3492237cc23c05f80e1fe8c91e612 WatchSource:0}: Error finding container ccfccb160377789a0198db777010307eedc3492237cc23c05f80e1fe8c91e612: Status 404 returned error can't find the container with id ccfccb160377789a0198db777010307eedc3492237cc23c05f80e1fe8c91e612
Jul 10 16:49:50.889089 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:50.889051    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"]
Jul 10 16:49:50.891349 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:49:50.891326    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360ea756_5e3b_4b4b_9031_d8f598531370.slice/crio-9c81a7fb4bbc6c747b482faaa131fc927f8f9153159429865b8ecf262f31a360 WatchSource:0}: Error finding container 9c81a7fb4bbc6c747b482faaa131fc927f8f9153159429865b8ecf262f31a360: Status 404 returned error can't find the container with id 9c81a7fb4bbc6c747b482faaa131fc927f8f9153159429865b8ecf262f31a360
Jul 10 16:49:51.215703 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:51.215669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k76hq" event={"ID":"60c5fcd8-54d6-4492-a515-47c8a7bc28d8","Type":"ContainerStarted","Data":"ccfccb160377789a0198db777010307eedc3492237cc23c05f80e1fe8c91e612"}
Jul 10 16:49:51.216845 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:51.216824    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879" event={"ID":"360ea756-5e3b-4b4b-9031-d8f598531370","Type":"ContainerStarted","Data":"9c81a7fb4bbc6c747b482faaa131fc927f8f9153159429865b8ecf262f31a360"}
Jul 10 16:49:51.218001 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:51.217978    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc" event={"ID":"7b26622e-d599-415c-8d70-197e2b6868f1","Type":"ContainerStarted","Data":"d2616f4023916f6991887d1c0c823391234ad80c8d230b68ea155175ad64a2f1"}
Jul 10 16:49:53.231062 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.231023    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k76hq" event={"ID":"60c5fcd8-54d6-4492-a515-47c8a7bc28d8","Type":"ContainerStarted","Data":"59b6190c31e973980dd53e51ff509138e3b40867cbb3f7277579ea6f1221e8a9"}
Jul 10 16:49:53.231539 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.231096    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:49:53.233290 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.233262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879" event={"ID":"360ea756-5e3b-4b4b-9031-d8f598531370","Type":"ContainerStarted","Data":"ae72566e5a181d3f3e69bdb9fcf3e2952d4479c0eaccd4062491be484da23dde"}
Jul 10 16:49:53.233438 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.233323    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:49:53.234799 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.234776    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc" event={"ID":"7b26622e-d599-415c-8d70-197e2b6868f1","Type":"ContainerStarted","Data":"121f95f92e3c53fe61fad679e2068856834374a060903a15a9063ffbac3ac999"}
Jul 10 16:49:53.234944 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.234905    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:49:53.250993 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.250948    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-k76hq" podStartSLOduration=1.450751635 podStartE2EDuration="3.250920037s" totalImagesPullingTime="1.800168402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:49:53.249195631 +0000 UTC m=+813.849371286" watchObservedRunningTime="2026-07-10 16:49:53.250920037 +0000 UTC m=+813.851095692"
Jul 10 16:49:53.270406 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.270360    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879" podStartSLOduration=2.499574566 podStartE2EDuration="4.270341627s" totalImagesPullingTime="1.770767061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:49:53.267880294 +0000 UTC m=+813.868055967" watchObservedRunningTime="2026-07-10 16:49:53.270341627 +0000 UTC m=+813.870517287"
Jul 10 16:49:53.284156 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:53.284116    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc" podStartSLOduration=1.454518403 podStartE2EDuration="3.284103177s" totalImagesPullingTime="1.829584774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:49:53.283131328 +0000 UTC m=+813.883306984" watchObservedRunningTime="2026-07-10 16:49:53.284103177 +0000 UTC m=+813.884278831"
Jul 10 16:49:59.253836 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:49:59.253805    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86cd8d977b-b6879"
Jul 10 16:50:00.251315 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:00.251272    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:50:00.353595 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:00.353553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:50:04.249793 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:04.249761    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-k76hq"
Jul 10 16:50:04.250301 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:04.250088    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-pbnsc"
Jul 10 16:50:06.575822 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.575789    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"]
Jul 10 16:50:06.579759 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.579739    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.583109 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.583082    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 16:50:06.584548 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.584525    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 10 16:50:06.584664 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.584565    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kjfph\""
Jul 10 16:50:06.584664 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.584588    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 16:50:06.590667 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.590645    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"]
Jul 10 16:50:06.610389 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.610357    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:50:06.695191 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.695151    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.695191 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.695197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.695379 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.695221    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.695379 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.695276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp49q\" (UniqueName: \"kubernetes.io/projected/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-kube-api-access-pp49q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.695379 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.695306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.695379 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.695330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.796646 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.796610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.796828 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.796656    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.796828 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.796680    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.796828 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.796714    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp49q\" (UniqueName: \"kubernetes.io/projected/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-kube-api-access-pp49q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.796828 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.796744    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.796828 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.796768    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.797173 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.797131    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.797173 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.797152    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.797250 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.797187    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.799068 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.799045    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.799279 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.799261    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.805269 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.805248    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp49q\" (UniqueName: \"kubernetes.io/projected/a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5-kube-api-access-pp49q\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72\" (UID: \"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:06.891301 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:06.891219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:07.027985 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:07.027952    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"]
Jul 10 16:50:07.031400 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:50:07.031372    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c29a48_6ea5_4607_a2d1_ef3a684fe9c5.slice/crio-4f7eab73de844cc452eb4bf90dba2e1c0a89a27540fbf100c429ea271fa15bae WatchSource:0}: Error finding container 4f7eab73de844cc452eb4bf90dba2e1c0a89a27540fbf100c429ea271fa15bae: Status 404 returned error can't find the container with id 4f7eab73de844cc452eb4bf90dba2e1c0a89a27540fbf100c429ea271fa15bae
Jul 10 16:50:07.313341 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:07.313298    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72" event={"ID":"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5","Type":"ContainerStarted","Data":"4f7eab73de844cc452eb4bf90dba2e1c0a89a27540fbf100c429ea271fa15bae"}
Jul 10 16:50:08.320471 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:08.320438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72" event={"ID":"a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5","Type":"ContainerStarted","Data":"bdcbec553abee571c2865a81dd16a2af1f9f9908eedf15197ec3043bfce3f323"}
Jul 10 16:50:08.339673 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:08.339612    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72" podStartSLOduration=1.1287128499999999 podStartE2EDuration="2.339596308s" totalImagesPullingTime="1.210883458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:50:08.338004557 +0000 UTC m=+828.938180212" watchObservedRunningTime="2026-07-10 16:50:08.339596308 +0000 UTC m=+828.939772046"
Jul 10 16:50:12.303596 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:12.303554    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:50:15.586377 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.586340    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"]
Jul 10 16:50:15.589889 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.589872    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.593109 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.593090    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 16:50:15.600101 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.600081    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"]
Jul 10 16:50:15.615162 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.615134    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:50:15.686284 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.686249    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca31e3dd-299a-40e9-8fa9-9ea306df7707-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.686490 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.686328    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.686490 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.686353    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.686490 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.686389    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.686609 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.686491    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.686609 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.686522    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c89p\" (UniqueName: \"kubernetes.io/projected/ca31e3dd-299a-40e9-8fa9-9ea306df7707-kube-api-access-6c89p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.787667 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.787630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.787667 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.787670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.787878 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.787800    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.787878 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.787866    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.788043 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.787887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c89p\" (UniqueName: \"kubernetes.io/projected/ca31e3dd-299a-40e9-8fa9-9ea306df7707-kube-api-access-6c89p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.788043 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.787981    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca31e3dd-299a-40e9-8fa9-9ea306df7707-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.788161 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.788060    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.788161 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.788145    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.788253 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.788202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.789971 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.789951    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca31e3dd-299a-40e9-8fa9-9ea306df7707-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.790346 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.790328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca31e3dd-299a-40e9-8fa9-9ea306df7707-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.796135 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.796114    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c89p\" (UniqueName: \"kubernetes.io/projected/ca31e3dd-299a-40e9-8fa9-9ea306df7707-kube-api-access-6c89p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-q2vfs\" (UID: \"ca31e3dd-299a-40e9-8fa9-9ea306df7707\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:15.900320 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:15.900290    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:16.036045 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:16.036021    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"]
Jul 10 16:50:16.038446 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:50:16.038418    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca31e3dd_299a_40e9_8fa9_9ea306df7707.slice/crio-4fd83a668c6f514f7cb2c8a306779a2fd2335922265dbc258d122b4ea36ec179 WatchSource:0}: Error finding container 4fd83a668c6f514f7cb2c8a306779a2fd2335922265dbc258d122b4ea36ec179: Status 404 returned error can't find the container with id 4fd83a668c6f514f7cb2c8a306779a2fd2335922265dbc258d122b4ea36ec179
Jul 10 16:50:16.359071 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:16.359029    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs" event={"ID":"ca31e3dd-299a-40e9-8fa9-9ea306df7707","Type":"ContainerStarted","Data":"96bf11a7c6776adcf0f9d55d0bb3ffc8c7bc908c59bc72c3419bf6aa3b7b823f"}
Jul 10 16:50:16.359232 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:16.359095    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs" event={"ID":"ca31e3dd-299a-40e9-8fa9-9ea306df7707","Type":"ContainerStarted","Data":"4fd83a668c6f514f7cb2c8a306779a2fd2335922265dbc258d122b4ea36ec179"}
Jul 10 16:50:16.377811 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:16.377765    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs" podStartSLOduration=1.191748033 podStartE2EDuration="1.377749393s" totalImagesPullingTime="186.00136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:50:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:50:16.37628829 +0000 UTC m=+836.976463964" watchObservedRunningTime="2026-07-10 16:50:16.377749393 +0000 UTC m=+836.977925047"
Jul 10 16:50:16.891510 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:16.891475    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:16.891889 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:16.891546    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:16.904183 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:16.904158    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:17.376455 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:17.376423    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72"
Jul 10 16:50:25.900618 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:25.900578    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:25.901112 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:25.900644    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:25.913124 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:25.913100    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:26.420232 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:26.420199    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-q2vfs"
Jul 10 16:50:31.383410 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.383371    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"]
Jul 10 16:50:31.390190 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.390162    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.393288 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.393263    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 10 16:50:31.397726 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.397702    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"]
Jul 10 16:50:31.428694 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.428661    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:50:31.445679 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.445651    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.445842 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.445683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.445842 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.445705    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.445842 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.445730    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4kqx\" (UniqueName: \"kubernetes.io/projected/11df3a43-1026-405e-98db-351e3ebe7e55-kube-api-access-w4kqx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.445842 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.445819    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11df3a43-1026-405e-98db-351e3ebe7e55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.446041 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.445848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.546615 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.546580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.546809 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.546623    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.546809 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.546657    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.546809 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.546685    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4kqx\" (UniqueName: \"kubernetes.io/projected/11df3a43-1026-405e-98db-351e3ebe7e55-kube-api-access-w4kqx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.546809 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.546776    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11df3a43-1026-405e-98db-351e3ebe7e55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.547076 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.546820    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.547166 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.547144    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.547299 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.547162    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.547299 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.547233    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.548965 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.548944    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11df3a43-1026-405e-98db-351e3ebe7e55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.549287 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.549268    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11df3a43-1026-405e-98db-351e3ebe7e55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.555675 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.555656    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4kqx\" (UniqueName: \"kubernetes.io/projected/11df3a43-1026-405e-98db-351e3ebe7e55-kube-api-access-w4kqx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5\" (UID: \"11df3a43-1026-405e-98db-351e3ebe7e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.702207 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.702174    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:31.838655 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:31.838632    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"]
Jul 10 16:50:31.840632 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:50:31.840602    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11df3a43_1026_405e_98db_351e3ebe7e55.slice/crio-b510ebbbd3eb4dd13a46988d11eb58a597751d1e244dc55c432ff8e99cfb95a1 WatchSource:0}: Error finding container b510ebbbd3eb4dd13a46988d11eb58a597751d1e244dc55c432ff8e99cfb95a1: Status 404 returned error can't find the container with id b510ebbbd3eb4dd13a46988d11eb58a597751d1e244dc55c432ff8e99cfb95a1
Jul 10 16:50:32.438519 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:32.438484    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5" event={"ID":"11df3a43-1026-405e-98db-351e3ebe7e55","Type":"ContainerStarted","Data":"f4ab6bde0927edba169ea62c68cfaee2226fb8a41940c80a9f7f8602d599f7a8"}
Jul 10 16:50:32.438899 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:32.438545    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5" event={"ID":"11df3a43-1026-405e-98db-351e3ebe7e55","Type":"ContainerStarted","Data":"b510ebbbd3eb4dd13a46988d11eb58a597751d1e244dc55c432ff8e99cfb95a1"}
Jul 10 16:50:32.458131 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:32.458082    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5" podStartSLOduration=1.2729932050000001 podStartE2EDuration="1.458064229s" totalImagesPullingTime="185.071024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:50:32.457434835 +0000 UTC m=+853.057610509" watchObservedRunningTime="2026-07-10 16:50:32.458064229 +0000 UTC m=+853.058239883"
Jul 10 16:50:37.920871 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:37.920837    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:50:39.723040 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:39.723007    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:50:41.702555 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:41.702521    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:41.702981 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:41.702581    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:41.714813 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:41.714789    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:42.497226 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:42.497196    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5"
Jul 10 16:50:47.146736 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:50:47.146699    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:51:20.032814 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:51:20.032705    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:51:20.037064 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:51:20.036829    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:51:20.039470 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:51:20.039449    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:51:20.046256 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:51:20.046235    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:51:47.160863 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:51:47.160828    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:51:48.584301 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:51:48.584266    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:52:07.683454 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:52:07.683412    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:52:49.552388 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:52:49.552343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:52:49.653536 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:52:49.653503    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:01.221223 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.221184    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:01.323959 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.323907    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4859d9f6-6vzmr"]
Jul 10 16:53:01.324167 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.324140    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-d4859d9f6-6vzmr" podUID="e5fbe313-e1be-4a87-91d9-b0e81473312b" containerName="manager" containerID="cri-o://d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac" gracePeriod=30
Jul 10 16:53:01.575106 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.575078    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:53:01.754795 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.754698    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5fbe313-e1be-4a87-91d9-b0e81473312b-webhook-cert\") pod \"e5fbe313-e1be-4a87-91d9-b0e81473312b\" (UID: \"e5fbe313-e1be-4a87-91d9-b0e81473312b\") "
Jul 10 16:53:01.755004 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.754819    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt8mz\" (UniqueName: \"kubernetes.io/projected/e5fbe313-e1be-4a87-91d9-b0e81473312b-kube-api-access-wt8mz\") pod \"e5fbe313-e1be-4a87-91d9-b0e81473312b\" (UID: \"e5fbe313-e1be-4a87-91d9-b0e81473312b\") "
Jul 10 16:53:01.756854 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.756830    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5fbe313-e1be-4a87-91d9-b0e81473312b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e5fbe313-e1be-4a87-91d9-b0e81473312b" (UID: "e5fbe313-e1be-4a87-91d9-b0e81473312b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 16:53:01.756947 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.756885    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5fbe313-e1be-4a87-91d9-b0e81473312b-kube-api-access-wt8mz" (OuterVolumeSpecName: "kube-api-access-wt8mz") pod "e5fbe313-e1be-4a87-91d9-b0e81473312b" (UID: "e5fbe313-e1be-4a87-91d9-b0e81473312b"). InnerVolumeSpecName "kube-api-access-wt8mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 16:53:01.856076 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.856041    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt8mz\" (UniqueName: \"kubernetes.io/projected/e5fbe313-e1be-4a87-91d9-b0e81473312b-kube-api-access-wt8mz\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:53:01.856076 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:01.856071    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e5fbe313-e1be-4a87-91d9-b0e81473312b-webhook-cert\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 16:53:02.189403 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.189367    2574 generic.go:356] "Generic (PLEG): container finished" podID="e5fbe313-e1be-4a87-91d9-b0e81473312b" containerID="d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac" exitCode=0
Jul 10 16:53:02.189574 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.189407    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4859d9f6-6vzmr"
Jul 10 16:53:02.189574 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.189420    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4859d9f6-6vzmr" event={"ID":"e5fbe313-e1be-4a87-91d9-b0e81473312b","Type":"ContainerDied","Data":"d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac"}
Jul 10 16:53:02.189574 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.189475    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4859d9f6-6vzmr" event={"ID":"e5fbe313-e1be-4a87-91d9-b0e81473312b","Type":"ContainerDied","Data":"e654a38cf0ecbeb5817472817047c81aee44820a29287fbe4778eb6bfb5b2c56"}
Jul 10 16:53:02.189574 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.189502    2574 scope.go:117] "RemoveContainer" containerID="d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac"
Jul 10 16:53:02.198268 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.198250    2574 scope.go:117] "RemoveContainer" containerID="d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac"
Jul 10 16:53:02.198528 ip-10-0-137-50 kubenswrapper[2574]: E0710 16:53:02.198508    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac\": container with ID starting with d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac not found: ID does not exist" containerID="d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac"
Jul 10 16:53:02.198594 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.198537    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac"} err="failed to get container status \"d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac\": rpc error: code = NotFound desc = could not find container \"d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac\": container with ID starting with d696d968e5e43e7f12bf5996918514db45b89ed49acefc7566220eba529be9ac not found: ID does not exist"
Jul 10 16:53:02.226451 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.226424    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-d4859d9f6-6vzmr"]
Jul 10 16:53:02.233034 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.233007    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-d4859d9f6-6vzmr"]
Jul 10 16:53:02.924558 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:02.924504    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:03.063371 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.063335    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-d4859d9f6-7tzjj"]
Jul 10 16:53:03.063747 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.063733    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5fbe313-e1be-4a87-91d9-b0e81473312b" containerName="manager"
Jul 10 16:53:03.063747 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.063746    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5fbe313-e1be-4a87-91d9-b0e81473312b" containerName="manager"
Jul 10 16:53:03.063883 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.063818    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5fbe313-e1be-4a87-91d9-b0e81473312b" containerName="manager"
Jul 10 16:53:03.068127 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.068107    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:03.078585 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.078563    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 16:53:03.079846 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.079816    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 16:53:03.079986 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.079857    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-njz59\""
Jul 10 16:53:03.085151 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.085126    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4859d9f6-7tzjj"]
Jul 10 16:53:03.169011 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.168963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b45de2e-bcab-40f6-adf0-d446d1d925b7-webhook-cert\") pod \"maas-controller-d4859d9f6-7tzjj\" (UID: \"8b45de2e-bcab-40f6-adf0-d446d1d925b7\") " pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:03.169193 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.169108    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j4zq\" (UniqueName: \"kubernetes.io/projected/8b45de2e-bcab-40f6-adf0-d446d1d925b7-kube-api-access-9j4zq\") pod \"maas-controller-d4859d9f6-7tzjj\" (UID: \"8b45de2e-bcab-40f6-adf0-d446d1d925b7\") " pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:03.270272 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.270171    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j4zq\" (UniqueName: \"kubernetes.io/projected/8b45de2e-bcab-40f6-adf0-d446d1d925b7-kube-api-access-9j4zq\") pod \"maas-controller-d4859d9f6-7tzjj\" (UID: \"8b45de2e-bcab-40f6-adf0-d446d1d925b7\") " pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:03.270272 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.270261    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b45de2e-bcab-40f6-adf0-d446d1d925b7-webhook-cert\") pod \"maas-controller-d4859d9f6-7tzjj\" (UID: \"8b45de2e-bcab-40f6-adf0-d446d1d925b7\") " pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:03.272600 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.272574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8b45de2e-bcab-40f6-adf0-d446d1d925b7-webhook-cert\") pod \"maas-controller-d4859d9f6-7tzjj\" (UID: \"8b45de2e-bcab-40f6-adf0-d446d1d925b7\") " pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:03.280175 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.280151    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j4zq\" (UniqueName: \"kubernetes.io/projected/8b45de2e-bcab-40f6-adf0-d446d1d925b7-kube-api-access-9j4zq\") pod \"maas-controller-d4859d9f6-7tzjj\" (UID: \"8b45de2e-bcab-40f6-adf0-d446d1d925b7\") " pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:03.386546 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.386512    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:03.531127 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.531099    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-d4859d9f6-7tzjj"]
Jul 10 16:53:03.532619 ip-10-0-137-50 kubenswrapper[2574]: W0710 16:53:03.532591    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b45de2e_bcab_40f6_adf0_d446d1d925b7.slice/crio-df59cefecdf3ca1b31f2a0048b39e7b49a845ce013ea630fa70dc309a5c4d753 WatchSource:0}: Error finding container df59cefecdf3ca1b31f2a0048b39e7b49a845ce013ea630fa70dc309a5c4d753: Status 404 returned error can't find the container with id df59cefecdf3ca1b31f2a0048b39e7b49a845ce013ea630fa70dc309a5c4d753
Jul 10 16:53:03.534048 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.534028    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 16:53:03.866986 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:03.866900    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5fbe313-e1be-4a87-91d9-b0e81473312b" path="/var/lib/kubelet/pods/e5fbe313-e1be-4a87-91d9-b0e81473312b/volumes"
Jul 10 16:53:04.200725 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:04.200699    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4859d9f6-7tzjj" event={"ID":"8b45de2e-bcab-40f6-adf0-d446d1d925b7","Type":"ContainerStarted","Data":"df59cefecdf3ca1b31f2a0048b39e7b49a845ce013ea630fa70dc309a5c4d753"}
Jul 10 16:53:05.206766 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:05.206727    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-d4859d9f6-7tzjj" event={"ID":"8b45de2e-bcab-40f6-adf0-d446d1d925b7","Type":"ContainerStarted","Data":"5fdbc252d444f2ab6f93cc1fc7fcafda456c70394abe49122598a9f1c010aaac"}
Jul 10 16:53:05.207223 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:05.206789    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:05.240101 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:05.240030    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-d4859d9f6-7tzjj" podStartSLOduration=1.598653484 podStartE2EDuration="2.24001035s" totalImagesPullingTime="641.356866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 16:53:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 16:53:05.239801129 +0000 UTC m=+1005.839976783" watchObservedRunningTime="2026-07-10 16:53:05.24001035 +0000 UTC m=+1005.840186005"
Jul 10 16:53:16.214074 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:16.214036    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-d4859d9f6-7tzjj"
Jul 10 16:53:42.307601 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:42.307565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:42.407192 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:42.407159    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:42.514074 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:42.514038    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:48.484718 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:48.484682    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:48.590776 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:48.590739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:48.692910 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:48.692868    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:48.834970 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:48.834855    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:54.770876 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:54.770839    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:53:54.853860 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:53:54.853827    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:54:53.732550 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:54:53.732511    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:54:53.833626 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:54:53.833591    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:55:19.876761 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:55:19.876733    2574 scope.go:117] "RemoveContainer" containerID="9d2c5d2340fb9cb950b1caced4aa452b2466c81d08a305772553ebcdbb9dbd30"
Jul 10 16:56:20.069201 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:56:20.069095    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:56:20.074553 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:56:20.074532    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 16:56:20.075291 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:56:20.075274    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:56:20.080447 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:56:20.080433    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 16:56:35.967219 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:56:35.967180    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:56:44.511421 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:56:44.511386    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 16:57:37.797113 ip-10-0-137-50 kubenswrapper[2574]: I0710 16:57:37.797074    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:00:14.359741 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:00:14.359663    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:00:14.449448 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:00:14.449413    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:01:20.100485 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:01:20.100370    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:01:20.106876 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:01:20.106854    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:01:20.107749 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:01:20.107730    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:01:20.114968 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:01:20.114945    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:02:47.290358 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:02:47.290326    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:04:27.531620 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:04:27.531582    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:04:37.162279 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:04:37.162225    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:04:48.782367 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:04:48.782268    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:04:57.019975 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:04:57.019915    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:02.117494 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:02.117454    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:04.888488 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:04.888443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:04.983084 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:04.983049    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:05.356749 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:05.356718    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:12.090050 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:12.090006    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:12.221028 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:12.220998    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:12.425352 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:12.425320    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:12.528728 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:12.528695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:13.496798 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:13.496767    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:13.615810 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:13.615782    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:13.756771 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:13.756692    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:13.883003 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:13.882971    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:14.400672 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:14.400637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:14.519474 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:14.519439    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:16.120075 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:16.119886    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:05:34.914502 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:05:34.914463    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:20.133914 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:20.133809    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:06:20.140007 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:20.139989    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:06:20.143148 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:20.143129    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:06:20.149140 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:20.149121    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:06:29.042183 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:29.042149    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:33.623694 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:33.623664    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:39.437883 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:39.437845    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:39.539483 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:39.539436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:43.832521 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:43.832489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:44.238879 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:44.238845    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:45.477499 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:45.477463    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:45.580193 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:45.580159    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:45.885731 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:45.885652    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:46.136177 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:46.136099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:06:46.299556 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:06:46.299521    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:07:00.281334 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:07:00.281292    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:07:00.341544 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:07:00.341505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:07:03.591213 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:07:03.591177    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:00.857187 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:00.857099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:03.390281 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:03.390246    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:06.599410 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:06.599374    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:11.258254 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:11.258212    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:11.323952 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:11.323895    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:16.481891 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:16.481851    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:16.801875 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:16.801846    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:18.007188 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:18.007155    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:18.104353 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:18.104316    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:18.247286 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:18.247250    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:18.576204 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:18.576172    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:18.818894 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:18.818861    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:18.916896 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:18.916867    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:23.040691 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:23.040659    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:23.140998 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:23.140959    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:24.679377 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:24.679342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:24.785880 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:24.785842    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:26.280325 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:26.280290    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:39.632701 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:39.632672    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:08:39.735139 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:08:39.735112    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:22.858121 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:22.858081    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:27.473231 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:27.473201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:33.354431 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:33.354397    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:33.445060 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:33.445031    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:37.671167 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:37.671136    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:38.257677 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:38.257608    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:38.437638 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:38.437592    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:39.850668 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:39.850622    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:44.323232 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:44.323202    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:45.605766 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:45.605734    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:45.706705 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:45.706677    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:45.848115 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:45.848082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:45.960661 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:45.960631    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:09:46.333317 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:09:46.333227    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:12.270970 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:12.270912    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:14.853041 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:14.853009    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:14.914102 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:14.914067    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:18.337195 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:18.337159    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:18.399578 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:18.399543    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:18.541068 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:18.541032    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:34.475572 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:34.475534    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:39.799420 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:39.799383    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:40.285846 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:40.285808    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:40.399522 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:40.399489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:40.492971 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:40.492914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:50.992355 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:50.992236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:51.772569 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:51.772535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:57.841466 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:57.841430    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:57.924210 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:57.924178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:58.328725 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:58.328695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:58.428569 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:58.428537    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:58.883217 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:58.883185    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:58.982581 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:58.982547    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:10:59.085085 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:10:59.085052    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:00.620839 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:00.620804    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:06.391090 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:06.391044    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:06.491065 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:06.491016    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:07.057598 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:07.057563    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:13.132598 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:13.132565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:13.193630 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:13.193582    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:13.381831 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:13.381797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:13.696000 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:13.695914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:14.122194 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:14.122081    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:16.667052 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:16.667021    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:16.790100 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:16.790068    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:16.878493 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:16.878457    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:16.989004 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:16.988909    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:17.469581 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:17.469552    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:17.568507 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:17.568477    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:20.167778 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:20.167750    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:11:20.173824 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:20.173805    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:11:20.176801 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:20.176782    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:11:20.182600 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:20.182582    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:11:21.151452 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:21.151420    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:21.802158 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:21.802117    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:21.900235 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:21.900172    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:22.227128 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:22.227091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:27.074272 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:27.074231    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:28.343995 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:28.343957    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:28.409050 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:28.409017    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:39.244104 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:39.244067    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:43.775002 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:43.774967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:49.600136 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:49.600103    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:49.701632 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:49.701604    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:54.452408 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:54.452376    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:54.688516 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:54.688484    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:54.814158 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:54.814076    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:54.911619 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:54.911587    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:11:55.017907 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:11:55.017872    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:00.673263 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:00.673224    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:00.778617 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:00.778581    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:00.873462 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:00.873420    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:01.021122 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:01.021033    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:06.831723 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:06.831684    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:06.932341 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:06.932312    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:13.575262 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:13.575188    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:13.932639 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:13.932601    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:14.300886 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:14.300804    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:16.978918 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:16.978884    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:17.111269 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:17.111233    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:17.195485 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:17.195447    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:17.373359 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:17.373277    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:17.681190 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:17.681153    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:17.782430 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:17.782400    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:21.444115 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:21.444079    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:28.245337 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:28.245300    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:12:59.970552 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:12:59.970518    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:13:04.534448 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:13:04.534416    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:13:09.602653 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:13:09.602619    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:13:25.449984 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:13:25.449949    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:13:25.555208 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:13:25.555178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:13:46.039544 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:13:46.039456    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:13:46.454158 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:13:46.454125    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:13:52.165132 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:13:52.165072    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:07.544189 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:07.544155    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:07.652973 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:07.652908    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:16.743270 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:16.743236    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:16.959768 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:16.959739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:18.025494 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:18.025458    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:18.111492 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:18.111461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:18.212075 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:18.212025    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:18.886887 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:18.886850    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:18.973359 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:18.973323    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:19.073971 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:19.073913    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:20.371571 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:20.371535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:26.340977 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:26.340946    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:26.413989 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:26.413951    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:26.988726 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:26.988698    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:32.843905 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:32.843869    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:32.948150 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:32.948117    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:33.044132 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:33.044099    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:43.519402 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:43.519366    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:14:43.833962 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:14:43.833856    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:04.770053 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:04.770013    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:10.507913 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:10.507881    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:10.572496 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:10.572467    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:10.850617 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:10.850531    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:11.144266 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:11.144182    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:11.383844 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:11.383808    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:13.946356 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:13.946276    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:14.045040 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:14.045004    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:14.145917 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:14.145887    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:14.374086 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:14.374000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:14.601103 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:14.601073    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:14.757418 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:14.757376    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:18.424739 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:18.424698    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:18.743175 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:18.743089    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:19.075666 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:19.075577    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:19.184818 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:19.184783    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:22.023798 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:22.023767    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:22.125758 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:22.125726    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:22.199552 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:22.199519    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:22.453698 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:22.453663    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:22.851573 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:22.851482    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:22.952671 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:22.952635    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:26.471255 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:26.471219    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:35.496993 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:35.496963    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:35.599157 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:35.599129    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:35.725196 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:35.725162    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:43.522523 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:43.522490    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:43.620545 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:43.620518    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:43.821235 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:43.821142    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:43.921802 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:43.921769    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:57.284954 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.284889    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"]
Jul 10 17:15:57.288702 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.288682    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.293463 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.293435    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a0f0a2\"/\"default-dockercfg-ch8s2\""
Jul 10 17:15:57.293591 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.293462    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a0f0a2\"/\"openshift-service-ca.crt\""
Jul 10 17:15:57.293591 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.293478    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a0f0a2\"/\"test-model-a0f0a2-kserve-self-signed-certs\""
Jul 10 17:15:57.293591 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.293442    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a0f0a2\"/\"kube-root-ca.crt\""
Jul 10 17:15:57.297828 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.297802    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"]
Jul 10 17:15:57.317943 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.317904    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:15:57.327201 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.327181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-dshm\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.327281 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.327259    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tls-certs\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.327327 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.327300    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-home\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.327368 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.327341    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tmp-dir\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.327410 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.327365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-model-cache\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.327480 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.327461    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldr4l\" (UniqueName: \"kubernetes.io/projected/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-kube-api-access-ldr4l\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428354 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-dshm\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428525 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428380    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tls-certs\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428525 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428413    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-home\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428525 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tmp-dir\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428525 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-model-cache\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428525 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldr4l\" (UniqueName: \"kubernetes.io/projected/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-kube-api-access-ldr4l\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428833 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428810    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tmp-dir\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428833 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428821    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-home\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.428968 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.428868    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-model-cache\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.430552 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.430531    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-dshm\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.430867 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.430850    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tls-certs\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.437572 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.437554    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldr4l\" (UniqueName: \"kubernetes.io/projected/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-kube-api-access-ldr4l\") pod \"test-model-a0f0a2-kserve-6cb567bcc7-6qnr6\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") " pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.598589 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.598495    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:15:57.742244 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:57.742219    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"]
Jul 10 17:15:57.744369 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:15:57.744342    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad21b7ba_087e_4bef_87aa_3cc3e15bcb2e.slice/crio-9979e578ca131b0e70b358f2d38ba94a6ebcc546e42d32fc31233e10afb8ae91 WatchSource:0}: Error finding container 9979e578ca131b0e70b358f2d38ba94a6ebcc546e42d32fc31233e10afb8ae91: Status 404 returned error can't find the container with id 9979e578ca131b0e70b358f2d38ba94a6ebcc546e42d32fc31233e10afb8ae91
Jul 10 17:15:58.007495 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:58.007463    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6" event={"ID":"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e","Type":"ContainerStarted","Data":"dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a"}
Jul 10 17:15:58.007495 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:58.007502    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6" event={"ID":"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e","Type":"ContainerStarted","Data":"9979e578ca131b0e70b358f2d38ba94a6ebcc546e42d32fc31233e10afb8ae91"}
Jul 10 17:15:58.028182 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:15:58.028117    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6" podStartSLOduration=1.028101247 podStartE2EDuration="1.028101247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:15:58.02657643 +0000 UTC m=+2378.626752087" watchObservedRunningTime="2026-07-10 17:15:58.028101247 +0000 UTC m=+2378.628276902"
Jul 10 17:16:07.599064 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:07.599026    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:16:07.599497 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:07.599078    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:16:07.611789 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:07.611758    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:16:08.077468 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:08.077438    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:16:10.787115 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:10.787073    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:10.841911 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:10.841877    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:19.797070 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:19.797039    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:20.199614 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:20.199504    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:16:20.205599 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:20.205572    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:16:20.209534 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:20.209516    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:16:20.215372 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:20.215354    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:16:20.698353 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:20.698321    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"]
Jul 10 17:16:20.720708 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:20.720663    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:21.412660 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:21.412625    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:21.514088 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:21.514048    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:31.283511 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:31.283471    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:35.718532 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:35.718486    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6" podUID="ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" containerName="main" containerID="cri-o://dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a" gracePeriod=45
Jul 10 17:16:35.904439 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:35.904381    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:35.976076 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:35.976016    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:16:36.019080 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019044    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldr4l\" (UniqueName: \"kubernetes.io/projected/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-kube-api-access-ldr4l\") pod \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") "
Jul 10 17:16:36.019311 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019126    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tmp-dir\") pod \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") "
Jul 10 17:16:36.019311 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019159    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-home\") pod \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") "
Jul 10 17:16:36.019311 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019190    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-model-cache\") pod \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") "
Jul 10 17:16:36.019311 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019287    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-dshm\") pod \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") "
Jul 10 17:16:36.019533 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019359    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tls-certs\") pod \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\" (UID: \"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e\") "
Jul 10 17:16:36.019533 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019415    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-home" (OuterVolumeSpecName: "home") pod "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" (UID: "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:16:36.019533 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019477    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" (UID: "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:16:36.019533 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019489    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-model-cache" (OuterVolumeSpecName: "model-cache") pod "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" (UID: "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:16:36.019730 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019650    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-home\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:16:36.019730 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019662    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-model-cache\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:16:36.019730 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.019673    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tmp-dir\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:16:36.021548 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.021516    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" (UID: "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:16:36.021665 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.021556    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-kube-api-access-ldr4l" (OuterVolumeSpecName: "kube-api-access-ldr4l") pod "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" (UID: "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e"). InnerVolumeSpecName "kube-api-access-ldr4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:16:36.021665 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.021562    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-dshm" (OuterVolumeSpecName: "dshm") pod "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" (UID: "ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:16:36.120546 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.120507    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-dshm\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:16:36.120546 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.120539    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-tls-certs\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:16:36.120546 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.120553    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldr4l\" (UniqueName: \"kubernetes.io/projected/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e-kube-api-access-ldr4l\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:16:36.205946 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.205905    2574 generic.go:356] "Generic (PLEG): container finished" podID="ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" containerID="dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a" exitCode=0
Jul 10 17:16:36.206145 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.205980    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"
Jul 10 17:16:36.206145 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.205992    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6" event={"ID":"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e","Type":"ContainerDied","Data":"dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a"}
Jul 10 17:16:36.206145 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.206033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6" event={"ID":"ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e","Type":"ContainerDied","Data":"9979e578ca131b0e70b358f2d38ba94a6ebcc546e42d32fc31233e10afb8ae91"}
Jul 10 17:16:36.206145 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.206051    2574 scope.go:117] "RemoveContainer" containerID="dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a"
Jul 10 17:16:36.216069 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.216045    2574 scope.go:117] "RemoveContainer" containerID="dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a"
Jul 10 17:16:36.216377 ip-10-0-137-50 kubenswrapper[2574]: E0710 17:16:36.216357    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a\": container with ID starting with dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a not found: ID does not exist" containerID="dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a"
Jul 10 17:16:36.216432 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.216386    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a"} err="failed to get container status \"dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a\": rpc error: code = NotFound desc = could not find container \"dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a\": container with ID starting with dbeb247b11a6e601da661a7569a9f7b3aa706c9026ac2ac8f59429d09b9b881a not found: ID does not exist"
Jul 10 17:16:36.230122 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.230047    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"]
Jul 10 17:16:36.233685 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:36.233661    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a0f0a2/test-model-a0f0a2-kserve-6cb567bcc7-6qnr6"]
Jul 10 17:16:37.867758 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:37.867717    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" path="/var/lib/kubelet/pods/ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e/volumes"
Jul 10 17:16:41.900721 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:41.900642    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:41.963699 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:41.963671    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:46.602136 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:46.602102    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:46.832185 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:46.832152    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:47.652668 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:47.652635    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:47.751008 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:47.750974    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:16:57.391964 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:16:57.391905    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:02.037512 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:02.037481    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:07.946900 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:07.946862    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:08.032766 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:08.032734    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:12.719123 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:12.719091    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:12.933541 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:12.933510    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:13.346044 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:13.346004    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:13.609263 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:13.609188    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:13.919813 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:13.919783    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:16.710651 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:16.710621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:16.807782 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:16.807752    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:16.944373 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:16.944340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:17.244404 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:17.244373    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:17.583271 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:17.583190    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:17.682940 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:17.682895    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:21.198744 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:21.198708    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:21.624302 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:21.624210    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:21.942649 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:21.942611    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:22.107317 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:22.107285    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:24.828578 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:24.828540    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:24.924539 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:24.924504    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:25.253829 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:25.253790    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:25.441184 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:25.441144    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:25.539769 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:25.539681    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:28.598702 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:28.598672    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:29.287396 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:29.287363    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:37.092572 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.092535    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"]
Jul 10 17:17:37.093018 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.093005    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" containerName="main"
Jul 10 17:17:37.093075 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.093020    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" containerName="main"
Jul 10 17:17:37.093111 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.093094    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad21b7ba-087e-4bef-87aa-3cc3e15bcb2e" containerName="main"
Jul 10 17:17:37.096368 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.096351    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"
Jul 10 17:17:37.099295 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.099271    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m9lhw\""
Jul 10 17:17:37.105607 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.105581    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"]
Jul 10 17:17:37.212540 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.212500    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9902eb7-3626-41f6-8e27-69f713a87f3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn\" (UID: \"e9902eb7-3626-41f6-8e27-69f713a87f3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"
Jul 10 17:17:37.313955 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.313907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9902eb7-3626-41f6-8e27-69f713a87f3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn\" (UID: \"e9902eb7-3626-41f6-8e27-69f713a87f3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"
Jul 10 17:17:37.314590 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.314568    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9902eb7-3626-41f6-8e27-69f713a87f3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn\" (UID: \"e9902eb7-3626-41f6-8e27-69f713a87f3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"
Jul 10 17:17:37.408089 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.408063    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"
Jul 10 17:17:37.551528 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.551490    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"]
Jul 10 17:17:37.551659 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:17:37.551602    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9902eb7_3626_41f6_8e27_69f713a87f3d.slice/crio-af647c6028a4b1582fa903f97f31685cacad0635f512ef3b537309176728b5c9 WatchSource:0}: Error finding container af647c6028a4b1582fa903f97f31685cacad0635f512ef3b537309176728b5c9: Status 404 returned error can't find the container with id af647c6028a4b1582fa903f97f31685cacad0635f512ef3b537309176728b5c9
Jul 10 17:17:37.553727 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.553711    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:17:37.731334 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.731245    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:37.832846 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:37.832815    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:38.521788 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:38.521752    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn" event={"ID":"e9902eb7-3626-41f6-8e27-69f713a87f3d","Type":"ContainerStarted","Data":"af647c6028a4b1582fa903f97f31685cacad0635f512ef3b537309176728b5c9"}
Jul 10 17:17:40.533996 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:40.533961    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn" event={"ID":"e9902eb7-3626-41f6-8e27-69f713a87f3d","Type":"ContainerStarted","Data":"fc664709f6ce63d2de29997414f8c91ba73ead8ebb8de8e2c39649223cd95201"}
Jul 10 17:17:40.552273 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:40.552223    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn" podStartSLOduration=1.05892853 podStartE2EDuration="3.552207692s" totalImagesPullingTime="2.493279162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:17:40.550367166 +0000 UTC m=+2481.150542820" watchObservedRunningTime="2026-07-10 17:17:40.552207692 +0000 UTC m=+2481.152383347"
Jul 10 17:17:41.540210 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:41.540173    2574 generic.go:356] "Generic (PLEG): container finished" podID="e9902eb7-3626-41f6-8e27-69f713a87f3d" containerID="fc664709f6ce63d2de29997414f8c91ba73ead8ebb8de8e2c39649223cd95201" exitCode=0
Jul 10 17:17:41.540600 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:41.540242    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn" event={"ID":"e9902eb7-3626-41f6-8e27-69f713a87f3d","Type":"ContainerDied","Data":"fc664709f6ce63d2de29997414f8c91ba73ead8ebb8de8e2c39649223cd95201"}
Jul 10 17:17:42.679279 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:42.679243    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"
Jul 10 17:17:42.769472 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:42.769428    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9902eb7-3626-41f6-8e27-69f713a87f3d-maas-api-service-ca\") pod \"e9902eb7-3626-41f6-8e27-69f713a87f3d\" (UID: \"e9902eb7-3626-41f6-8e27-69f713a87f3d\") "
Jul 10 17:17:42.769764 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:42.769736    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9902eb7-3626-41f6-8e27-69f713a87f3d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9902eb7-3626-41f6-8e27-69f713a87f3d" (UID: "e9902eb7-3626-41f6-8e27-69f713a87f3d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:17:42.871130 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:42.871043    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9902eb7-3626-41f6-8e27-69f713a87f3d-maas-api-service-ca\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:17:43.550920 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:43.550873    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn" event={"ID":"e9902eb7-3626-41f6-8e27-69f713a87f3d","Type":"ContainerDied","Data":"af647c6028a4b1582fa903f97f31685cacad0635f512ef3b537309176728b5c9"}
Jul 10 17:17:43.550920 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:43.550896    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn"
Jul 10 17:17:43.551213 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:43.550952    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af647c6028a4b1582fa903f97f31685cacad0635f512ef3b537309176728b5c9"
Jul 10 17:17:47.411462 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:47.411433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:47.514740 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:47.514706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:47.703430 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:47.703333    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:51.229737 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:51.229704    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:52.194132 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:52.194102    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:58.149380 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:58.149342    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:17:58.219871 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:17:58.219841    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:02.877842 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:02.877812    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:03.072202 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:03.072166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:13.650027 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:13.649922    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:18.293285 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:18.293248    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:24.366375 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:24.366343    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:24.435786 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:24.435749    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:26.202767 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:26.202731    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:26.307218 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:26.307183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:28.956155 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:28.956126    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:29.188144 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:29.188111    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:29.523422 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:29.523391    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:29.838817 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:29.838724    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:30.062682 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:30.062642    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:33.187145 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:33.187116    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:33.285547 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:33.285514    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:33.352323 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:33.352273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:33.473046 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:33.472959    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:33.847360 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:33.847279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:33.948478 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:33.948444    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:37.662411 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:37.662382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:37.983812 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:37.983727    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:38.316796 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:38.316710    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:38.833315 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:38.833280    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:41.254478 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:41.254442    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:41.341188 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:41.341154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:41.558104 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:41.558021    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:41.981232 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:41.981193    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:42.081460 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:42.081421    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:42.181052 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:42.181014    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:45.706401 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:45.706372    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:54.617031 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:54.616989    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:54.718483 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:54.718445    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:56.084639 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.084607    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"]
Jul 10 17:18:56.085114 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.085051    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9902eb7-3626-41f6-8e27-69f713a87f3d" containerName="revoke-keys"
Jul 10 17:18:56.085114 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.085065    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9902eb7-3626-41f6-8e27-69f713a87f3d" containerName="revoke-keys"
Jul 10 17:18:56.085199 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.085137    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9902eb7-3626-41f6-8e27-69f713a87f3d" containerName="revoke-keys"
Jul 10 17:18:56.088174 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.088155    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.092573 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.092548    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fd7cfb\"/\"openshift-service-ca.crt\""
Jul 10 17:18:56.092573 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.092548    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fd7cfb\"/\"default-dockercfg-lpjn8\""
Jul 10 17:18:56.092776 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.092613    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fd7cfb\"/\"auth-test-model-fd7cfb-kserve-self-signed-certs\""
Jul 10 17:18:56.092776 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.092557    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fd7cfb\"/\"kube-root-ca.crt\""
Jul 10 17:18:56.096871 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.096846    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"]
Jul 10 17:18:56.109963 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.109907    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:18:56.153291 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.153260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tmp-dir\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.153447 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.153304    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gsn\" (UniqueName: \"kubernetes.io/projected/b1b17149-ff6d-44a7-9a8f-3b1663fff031-kube-api-access-29gsn\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.153447 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.153407    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-home\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.153447 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.153436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tls-certs\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.153599 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.153460    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-dshm\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.153657 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.153608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-model-cache\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255121 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255079    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-model-cache\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255312 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tmp-dir\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255312 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255159    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29gsn\" (UniqueName: \"kubernetes.io/projected/b1b17149-ff6d-44a7-9a8f-3b1663fff031-kube-api-access-29gsn\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255312 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255210    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-home\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255312 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255235    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tls-certs\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255312 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255262    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-dshm\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255564 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255526    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-model-cache\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255623 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255574    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tmp-dir\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.255623 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.255594    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-home\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.257576 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.257546    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-dshm\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.257727 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.257711    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tls-certs\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.264027 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.264003    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gsn\" (UniqueName: \"kubernetes.io/projected/b1b17149-ff6d-44a7-9a8f-3b1663fff031-kube-api-access-29gsn\") pod \"auth-test-model-fd7cfb-kserve-6b469d7975-9mljw\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") " pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.397912 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.397884    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:18:56.539390 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.539363    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"]
Jul 10 17:18:56.541626 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:18:56.541590    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1b17149_ff6d_44a7_9a8f_3b1663fff031.slice/crio-1c4a2d5e9b11967052593baefa26b41dc58dad571b58272162cda4005c97c41b WatchSource:0}: Error finding container 1c4a2d5e9b11967052593baefa26b41dc58dad571b58272162cda4005c97c41b: Status 404 returned error can't find the container with id 1c4a2d5e9b11967052593baefa26b41dc58dad571b58272162cda4005c97c41b
Jul 10 17:18:56.925190 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.925158    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw" event={"ID":"b1b17149-ff6d-44a7-9a8f-3b1663fff031","Type":"ContainerStarted","Data":"4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f"}
Jul 10 17:18:56.925376 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.925201    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw" event={"ID":"b1b17149-ff6d-44a7-9a8f-3b1663fff031","Type":"ContainerStarted","Data":"1c4a2d5e9b11967052593baefa26b41dc58dad571b58272162cda4005c97c41b"}
Jul 10 17:18:56.943340 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:18:56.943290    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw" podStartSLOduration=0.943274501 podStartE2EDuration="943.274501ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:18:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:18:56.942412989 +0000 UTC m=+2557.542588669" watchObservedRunningTime="2026-07-10 17:18:56.943274501 +0000 UTC m=+2557.543450155"
Jul 10 17:19:02.762460 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:19:02.762412    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:19:02.863162 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:19:02.863124    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:19:06.398073 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:19:06.398032    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:19:06.398529 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:19:06.398098    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:19:06.413635 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:19:06.413595    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:19:06.991425 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:19:06.991394    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:19:27.925364 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:19:27.925334    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:20:54.808200 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:20:54.808166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:20:54.908585 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:20:54.908549    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:20:55.369386 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:20:55.369335    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:21:20.239613 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:20.239506    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:21:20.245807 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:20.245784    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:21:20.249500 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:20.249479    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:21:20.254997 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:20.254974    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:21:34.897002 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:34.896966    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"]
Jul 10 17:21:34.916117 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:34.916087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:21:35.805101 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:35.805068    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:21:39.304274 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.304242    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"]
Jul 10 17:21:39.307553 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.307535    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.310739 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.310719    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fd7cfb\"/\"sub-test-model-fd7cfb-kserve-self-signed-certs\""
Jul 10 17:21:39.320096 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.320071    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"]
Jul 10 17:21:39.330520 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.330481    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:21:39.405517 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.405480    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tmp-dir\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.405517 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.405513    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-home\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.405731 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.405618    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tls-certs\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.405731 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.405664    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8bv\" (UniqueName: \"kubernetes.io/projected/6eabe050-f7ba-42fa-ba4b-f275f044a40a-kube-api-access-wc8bv\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.405731 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.405686    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-model-cache\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.405847 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.405738    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-dshm\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.506656 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.506627    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tmp-dir\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.506836 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.506664    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-home\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.506836 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.506711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tls-certs\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.506836 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.506740    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8bv\" (UniqueName: \"kubernetes.io/projected/6eabe050-f7ba-42fa-ba4b-f275f044a40a-kube-api-access-wc8bv\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.506836 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.506759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-model-cache\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.507098 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.506891    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-dshm\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.507098 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.507089    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tmp-dir\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.507204 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.507104    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-home\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.507204 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.507174    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-model-cache\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.508950 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.508902    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-dshm\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.509287 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.509268    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tls-certs\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.516266 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.516247    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8bv\" (UniqueName: \"kubernetes.io/projected/6eabe050-f7ba-42fa-ba4b-f275f044a40a-kube-api-access-wc8bv\") pod \"sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") " pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.616580 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.616486    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:39.753076 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.752977    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"]
Jul 10 17:21:39.757897 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:21:39.757869    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6eabe050_f7ba_42fa_ba4b_f275f044a40a.slice/crio-e93c3a0eac4c7a316ea4068187108660afcb5aaec4b118a97c253880100c7323 WatchSource:0}: Error finding container e93c3a0eac4c7a316ea4068187108660afcb5aaec4b118a97c253880100c7323: Status 404 returned error can't find the container with id e93c3a0eac4c7a316ea4068187108660afcb5aaec4b118a97c253880100c7323
Jul 10 17:21:39.771567 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:39.771536    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh" event={"ID":"6eabe050-f7ba-42fa-ba4b-f275f044a40a","Type":"ContainerStarted","Data":"e93c3a0eac4c7a316ea4068187108660afcb5aaec4b118a97c253880100c7323"}
Jul 10 17:21:40.777857 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:40.777815    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh" event={"ID":"6eabe050-f7ba-42fa-ba4b-f275f044a40a","Type":"ContainerStarted","Data":"c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef"}
Jul 10 17:21:40.797267 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:40.797219    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh" podStartSLOduration=1.797203186 podStartE2EDuration="1.797203186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:21:40.795805337 +0000 UTC m=+2721.395980993" watchObservedRunningTime="2026-07-10 17:21:40.797203186 +0000 UTC m=+2721.397378841"
Jul 10 17:21:49.617047 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:49.617011    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:49.617456 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:49.617068    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:49.629410 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:49.629382    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:49.832804 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:49.832770    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:21:49.917238 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:49.917184    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw" podUID="b1b17149-ff6d-44a7-9a8f-3b1663fff031" containerName="main" containerID="cri-o://4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f" gracePeriod=45
Jul 10 17:21:50.170477 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.170415    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:21:50.317703 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.317673    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tls-certs\") pod \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") "
Jul 10 17:21:50.317883 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.317718    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29gsn\" (UniqueName: \"kubernetes.io/projected/b1b17149-ff6d-44a7-9a8f-3b1663fff031-kube-api-access-29gsn\") pod \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") "
Jul 10 17:21:50.317883 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.317752    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-home\") pod \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") "
Jul 10 17:21:50.317883 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.317821    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-dshm\") pod \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") "
Jul 10 17:21:50.317883 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.317862    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tmp-dir\") pod \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") "
Jul 10 17:21:50.318140 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.317901    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-model-cache\") pod \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\" (UID: \"b1b17149-ff6d-44a7-9a8f-3b1663fff031\") "
Jul 10 17:21:50.318207 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.318149    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-home" (OuterVolumeSpecName: "home") pod "b1b17149-ff6d-44a7-9a8f-3b1663fff031" (UID: "b1b17149-ff6d-44a7-9a8f-3b1663fff031"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:21:50.318207 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.318158    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1b17149-ff6d-44a7-9a8f-3b1663fff031" (UID: "b1b17149-ff6d-44a7-9a8f-3b1663fff031"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:21:50.318309 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.318220    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1b17149-ff6d-44a7-9a8f-3b1663fff031" (UID: "b1b17149-ff6d-44a7-9a8f-3b1663fff031"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:21:50.318309 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.318285    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tmp-dir\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:21:50.318309 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.318303    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-home\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:21:50.320096 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.320062    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-dshm" (OuterVolumeSpecName: "dshm") pod "b1b17149-ff6d-44a7-9a8f-3b1663fff031" (UID: "b1b17149-ff6d-44a7-9a8f-3b1663fff031"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:21:50.320202 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.320120    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b17149-ff6d-44a7-9a8f-3b1663fff031-kube-api-access-29gsn" (OuterVolumeSpecName: "kube-api-access-29gsn") pod "b1b17149-ff6d-44a7-9a8f-3b1663fff031" (UID: "b1b17149-ff6d-44a7-9a8f-3b1663fff031"). InnerVolumeSpecName "kube-api-access-29gsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:21:50.320202 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.320129    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1b17149-ff6d-44a7-9a8f-3b1663fff031" (UID: "b1b17149-ff6d-44a7-9a8f-3b1663fff031"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:21:50.419380 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.419330    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-dshm\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:21:50.419380 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.419374    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1b17149-ff6d-44a7-9a8f-3b1663fff031-model-cache\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:21:50.419380 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.419383    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1b17149-ff6d-44a7-9a8f-3b1663fff031-tls-certs\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:21:50.419380 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.419394    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29gsn\" (UniqueName: \"kubernetes.io/projected/b1b17149-ff6d-44a7-9a8f-3b1663fff031-kube-api-access-29gsn\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:21:50.827707 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.827674    2574 generic.go:356] "Generic (PLEG): container finished" podID="b1b17149-ff6d-44a7-9a8f-3b1663fff031" containerID="4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f" exitCode=0
Jul 10 17:21:50.828183 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.827726    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"
Jul 10 17:21:50.828183 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.827765    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw" event={"ID":"b1b17149-ff6d-44a7-9a8f-3b1663fff031","Type":"ContainerDied","Data":"4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f"}
Jul 10 17:21:50.828183 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.827811    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw" event={"ID":"b1b17149-ff6d-44a7-9a8f-3b1663fff031","Type":"ContainerDied","Data":"1c4a2d5e9b11967052593baefa26b41dc58dad571b58272162cda4005c97c41b"}
Jul 10 17:21:50.828183 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.827834    2574 scope.go:117] "RemoveContainer" containerID="4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f"
Jul 10 17:21:50.837653 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.837634    2574 scope.go:117] "RemoveContainer" containerID="4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f"
Jul 10 17:21:50.837920 ip-10-0-137-50 kubenswrapper[2574]: E0710 17:21:50.837897    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f\": container with ID starting with 4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f not found: ID does not exist" containerID="4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f"
Jul 10 17:21:50.838042 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.837951    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f"} err="failed to get container status \"4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f\": rpc error: code = NotFound desc = could not find container \"4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f\": container with ID starting with 4422553fd8c4cfa2639f855eb32461974acb751eb0ab59c55d977ac137ec5b2f not found: ID does not exist"
Jul 10 17:21:50.850548 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.850522    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"]
Jul 10 17:21:50.863327 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:50.863300    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/auth-test-model-fd7cfb-kserve-6b469d7975-9mljw"]
Jul 10 17:21:51.867780 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:21:51.867746    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b17149-ff6d-44a7-9a8f-3b1663fff031" path="/var/lib/kubelet/pods/b1b17149-ff6d-44a7-9a8f-3b1663fff031/volumes"
Jul 10 17:22:11.583865 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:22:11.583834    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:22:56.526251 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:22:56.526218    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"]
Jul 10 17:22:56.551474 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:22:56.551443    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:22:57.320453 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:22:57.320425    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:23:11.546341 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.546281    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh" podUID="6eabe050-f7ba-42fa-ba4b-f275f044a40a" containerName="main" containerID="cri-o://c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef" gracePeriod=45
Jul 10 17:23:11.805272 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.805211    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:23:11.994454 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.994423    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tls-certs\") pod \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") "
Jul 10 17:23:11.994643 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.994479    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc8bv\" (UniqueName: \"kubernetes.io/projected/6eabe050-f7ba-42fa-ba4b-f275f044a40a-kube-api-access-wc8bv\") pod \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") "
Jul 10 17:23:11.994643 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.994566    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-model-cache\") pod \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") "
Jul 10 17:23:11.994643 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.994596    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-dshm\") pod \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") "
Jul 10 17:23:11.994643 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.994628    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tmp-dir\") pod \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") "
Jul 10 17:23:11.994867 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.994723    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-home\") pod \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\" (UID: \"6eabe050-f7ba-42fa-ba4b-f275f044a40a\") "
Jul 10 17:23:11.994867 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.994838    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-model-cache" (OuterVolumeSpecName: "model-cache") pod "6eabe050-f7ba-42fa-ba4b-f275f044a40a" (UID: "6eabe050-f7ba-42fa-ba4b-f275f044a40a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:23:11.995016 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.994994    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6eabe050-f7ba-42fa-ba4b-f275f044a40a" (UID: "6eabe050-f7ba-42fa-ba4b-f275f044a40a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:23:11.995077 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.995015    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-home" (OuterVolumeSpecName: "home") pod "6eabe050-f7ba-42fa-ba4b-f275f044a40a" (UID: "6eabe050-f7ba-42fa-ba4b-f275f044a40a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:23:11.995182 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.995165    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-model-cache\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:23:11.995235 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.995183    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tmp-dir\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:23:11.995235 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.995192    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-home\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:23:11.996621 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.996588    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-dshm" (OuterVolumeSpecName: "dshm") pod "6eabe050-f7ba-42fa-ba4b-f275f044a40a" (UID: "6eabe050-f7ba-42fa-ba4b-f275f044a40a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:23:11.996754 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.996648    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6eabe050-f7ba-42fa-ba4b-f275f044a40a" (UID: "6eabe050-f7ba-42fa-ba4b-f275f044a40a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:23:11.996754 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:11.996670    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eabe050-f7ba-42fa-ba4b-f275f044a40a-kube-api-access-wc8bv" (OuterVolumeSpecName: "kube-api-access-wc8bv") pod "6eabe050-f7ba-42fa-ba4b-f275f044a40a" (UID: "6eabe050-f7ba-42fa-ba4b-f275f044a40a"). InnerVolumeSpecName "kube-api-access-wc8bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:23:12.096412 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.096333    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eabe050-f7ba-42fa-ba4b-f275f044a40a-tls-certs\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:23:12.096412 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.096364    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc8bv\" (UniqueName: \"kubernetes.io/projected/6eabe050-f7ba-42fa-ba4b-f275f044a40a-kube-api-access-wc8bv\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:23:12.096412 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.096372    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6eabe050-f7ba-42fa-ba4b-f275f044a40a-dshm\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:23:12.236200 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.236168    2574 generic.go:356] "Generic (PLEG): container finished" podID="6eabe050-f7ba-42fa-ba4b-f275f044a40a" containerID="c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef" exitCode=0
Jul 10 17:23:12.236384 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.236208    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"
Jul 10 17:23:12.236384 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.236246    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh" event={"ID":"6eabe050-f7ba-42fa-ba4b-f275f044a40a","Type":"ContainerDied","Data":"c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef"}
Jul 10 17:23:12.236384 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.236293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh" event={"ID":"6eabe050-f7ba-42fa-ba4b-f275f044a40a","Type":"ContainerDied","Data":"e93c3a0eac4c7a316ea4068187108660afcb5aaec4b118a97c253880100c7323"}
Jul 10 17:23:12.236384 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.236318    2574 scope.go:117] "RemoveContainer" containerID="c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef"
Jul 10 17:23:12.245865 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.245850    2574 scope.go:117] "RemoveContainer" containerID="c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef"
Jul 10 17:23:12.246126 ip-10-0-137-50 kubenswrapper[2574]: E0710 17:23:12.246102    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef\": container with ID starting with c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef not found: ID does not exist" containerID="c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef"
Jul 10 17:23:12.246207 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.246139    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef"} err="failed to get container status \"c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef\": rpc error: code = NotFound desc = could not find container \"c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef\": container with ID starting with c2418a40dc8413f0a78a71ad4d67b6365180f2440e00b02fbc9ac9f43410c6ef not found: ID does not exist"
Jul 10 17:23:12.262134 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.262106    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"]
Jul 10 17:23:12.267032 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.267006    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fd7cfb/sub-test-model-fd7cfb-kserve-f8f5c4f6c-qb7sh"]
Jul 10 17:23:12.714691 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.714627    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:23:12.816331 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:12.816292    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:23:13.867480 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:13.867442    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eabe050-f7ba-42fa-ba4b-f275f044a40a" path="/var/lib/kubelet/pods/6eabe050-f7ba-42fa-ba4b-f275f044a40a/volumes"
Jul 10 17:23:17.341076 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:17.341043    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:23:26.948693 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:26.948664    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:23:27.051596 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:27.051565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:23:55.546818 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:55.546772    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:23:55.646901 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:23:55.646829    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:24:03.502421 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:03.502368    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:24:03.603684 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:03.603655    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:24:05.408562 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.408524    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"]
Jul 10 17:24:05.409037 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.409021    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b17149-ff6d-44a7-9a8f-3b1663fff031" containerName="main"
Jul 10 17:24:05.409095 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.409041    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b17149-ff6d-44a7-9a8f-3b1663fff031" containerName="main"
Jul 10 17:24:05.409095 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.409059    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eabe050-f7ba-42fa-ba4b-f275f044a40a" containerName="main"
Jul 10 17:24:05.409095 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.409065    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eabe050-f7ba-42fa-ba4b-f275f044a40a" containerName="main"
Jul 10 17:24:05.409188 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.409131    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b17149-ff6d-44a7-9a8f-3b1663fff031" containerName="main"
Jul 10 17:24:05.409188 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.409143    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eabe050-f7ba-42fa-ba4b-f275f044a40a" containerName="main"
Jul 10 17:24:05.412700 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.412679    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.415973 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.415948    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c9789a\"/\"openshift-service-ca.crt\""
Jul 10 17:24:05.417413 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.417386    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c9789a\"/\"kube-root-ca.crt\""
Jul 10 17:24:05.417552 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.417475    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c9789a\"/\"default-dockercfg-glf44\""
Jul 10 17:24:05.417552 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.417488    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c9789a\"/\"rate-test-model-c9789a-kserve-self-signed-certs\""
Jul 10 17:24:05.420604 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.420579    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"]
Jul 10 17:24:05.496117 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.496068    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:24:05.520537 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.520502    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pfwv\" (UniqueName: \"kubernetes.io/projected/4d816f4e-b4a2-4523-9329-e10879ea2969-kube-api-access-8pfwv\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.520715 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.520570    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-model-cache\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.520715 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.520601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-home\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.520834 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.520716    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d816f4e-b4a2-4523-9329-e10879ea2969-tls-certs\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.520834 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.520739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-tmp-dir\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.520834 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.520767    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-dshm\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621395 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-model-cache\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621550 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-home\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621550 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621466    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d816f4e-b4a2-4523-9329-e10879ea2969-tls-certs\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621550 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621481    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-tmp-dir\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621550 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621499    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-dshm\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621550 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621531    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pfwv\" (UniqueName: \"kubernetes.io/projected/4d816f4e-b4a2-4523-9329-e10879ea2969-kube-api-access-8pfwv\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621833 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621812    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-home\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621899 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621809    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-model-cache\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.621899 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.621858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-tmp-dir\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.623832 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.623806    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-dshm\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.623960 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.623924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d816f4e-b4a2-4523-9329-e10879ea2969-tls-certs\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.630607 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.630583    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pfwv\" (UniqueName: \"kubernetes.io/projected/4d816f4e-b4a2-4523-9329-e10879ea2969-kube-api-access-8pfwv\") pod \"rate-test-model-c9789a-kserve-7458bfd559-5svhx\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") " pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.722362 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.722285    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:05.857907 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:05.857883    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"]
Jul 10 17:24:05.859813 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:24:05.859780    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d816f4e_b4a2_4523_9329_e10879ea2969.slice/crio-5bcba8e50df4ec2bc3dd2c23fefe39f361898ef03cff6a7286e54e89d2217cd2 WatchSource:0}: Error finding container 5bcba8e50df4ec2bc3dd2c23fefe39f361898ef03cff6a7286e54e89d2217cd2: Status 404 returned error can't find the container with id 5bcba8e50df4ec2bc3dd2c23fefe39f361898ef03cff6a7286e54e89d2217cd2
Jul 10 17:24:06.515985 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:06.515949    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx" event={"ID":"4d816f4e-b4a2-4523-9329-e10879ea2969","Type":"ContainerStarted","Data":"4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a"}
Jul 10 17:24:06.516392 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:06.515996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx" event={"ID":"4d816f4e-b4a2-4523-9329-e10879ea2969","Type":"ContainerStarted","Data":"5bcba8e50df4ec2bc3dd2c23fefe39f361898ef03cff6a7286e54e89d2217cd2"}
Jul 10 17:24:06.534389 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:06.534340    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx" podStartSLOduration=1.5343252760000001 podStartE2EDuration="1.534325276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:24:06.533493808 +0000 UTC m=+2867.133669475" watchObservedRunningTime="2026-07-10 17:24:06.534325276 +0000 UTC m=+2867.134500930"
Jul 10 17:24:15.723587 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:15.723497    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:15.723587 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:15.723555    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:15.736117 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:15.736085    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:16.578115 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:16.578077    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:24:19.681448 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:19.681412    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:24:19.781190 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:19.781155    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:24:48.959644 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:48.959614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:24:49.975432 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:49.975395    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"]
Jul 10 17:24:50.000039 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:50.000008    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:24:50.899861 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:50.899824    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7504-139898138354352"]
Jul 10 17:24:50.903654 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:50.903637    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-139898138354352"
Jul 10 17:24:50.906476 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:50.906454    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-dkfct\""
Jul 10 17:24:50.907961 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:50.907914    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-139898138354352"]
Jul 10 17:24:50.925370 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:50.925346    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t494n\" (UniqueName: \"kubernetes.io/projected/940d8b2d-70f7-4f08-9b2d-7c7e577f2c80-kube-api-access-t494n\") pod \"test-curl-7504-139898138354352\" (UID: \"940d8b2d-70f7-4f08-9b2d-7c7e577f2c80\") " pod="openshift-ingress/test-curl-7504-139898138354352"
Jul 10 17:24:51.026175 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:51.026141    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t494n\" (UniqueName: \"kubernetes.io/projected/940d8b2d-70f7-4f08-9b2d-7c7e577f2c80-kube-api-access-t494n\") pod \"test-curl-7504-139898138354352\" (UID: \"940d8b2d-70f7-4f08-9b2d-7c7e577f2c80\") " pod="openshift-ingress/test-curl-7504-139898138354352"
Jul 10 17:24:51.042537 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:51.042515    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t494n\" (UniqueName: \"kubernetes.io/projected/940d8b2d-70f7-4f08-9b2d-7c7e577f2c80-kube-api-access-t494n\") pod \"test-curl-7504-139898138354352\" (UID: \"940d8b2d-70f7-4f08-9b2d-7c7e577f2c80\") " pod="openshift-ingress/test-curl-7504-139898138354352"
Jul 10 17:24:51.214465 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:51.214381    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-139898138354352"
Jul 10 17:24:51.352569 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:51.352540    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-139898138354352"]
Jul 10 17:24:51.354617 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:24:51.354592    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod940d8b2d_70f7_4f08_9b2d_7c7e577f2c80.slice/crio-54dea082ad6aced5ef08c2eee0ec900b7d090b30fdef6a6ebd6c742724d860ec WatchSource:0}: Error finding container 54dea082ad6aced5ef08c2eee0ec900b7d090b30fdef6a6ebd6c742724d860ec: Status 404 returned error can't find the container with id 54dea082ad6aced5ef08c2eee0ec900b7d090b30fdef6a6ebd6c742724d860ec
Jul 10 17:24:51.356141 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:51.356121    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 17:24:51.753726 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:51.753682    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-139898138354352" event={"ID":"940d8b2d-70f7-4f08-9b2d-7c7e577f2c80","Type":"ContainerStarted","Data":"54dea082ad6aced5ef08c2eee0ec900b7d090b30fdef6a6ebd6c742724d860ec"}
Jul 10 17:24:52.759969 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:52.759922    2574 generic.go:356] "Generic (PLEG): container finished" podID="940d8b2d-70f7-4f08-9b2d-7c7e577f2c80" containerID="bdc016cc313e2e4af0a4d93839fddaea2a255ad738457419d40c7eec7cb87a6f" exitCode=0
Jul 10 17:24:52.759969 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:52.759963    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-139898138354352" event={"ID":"940d8b2d-70f7-4f08-9b2d-7c7e577f2c80","Type":"ContainerDied","Data":"bdc016cc313e2e4af0a4d93839fddaea2a255ad738457419d40c7eec7cb87a6f"}
Jul 10 17:24:53.896758 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:53.896730    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-139898138354352"
Jul 10 17:24:53.918026 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:53.918002    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7504-139898138354352_940d8b2d-70f7-4f08-9b2d-7c7e577f2c80/test-curl-7504-139898138354352/0.log"
Jul 10 17:24:53.942624 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:53.942595    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7504-139898138354352"]
Jul 10 17:24:53.946453 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:53.946428    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7504-139898138354352"]
Jul 10 17:24:53.956067 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:53.956047    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t494n\" (UniqueName: \"kubernetes.io/projected/940d8b2d-70f7-4f08-9b2d-7c7e577f2c80-kube-api-access-t494n\") pod \"940d8b2d-70f7-4f08-9b2d-7c7e577f2c80\" (UID: \"940d8b2d-70f7-4f08-9b2d-7c7e577f2c80\") "
Jul 10 17:24:53.958152 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:53.958130    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/940d8b2d-70f7-4f08-9b2d-7c7e577f2c80-kube-api-access-t494n" (OuterVolumeSpecName: "kube-api-access-t494n") pod "940d8b2d-70f7-4f08-9b2d-7c7e577f2c80" (UID: "940d8b2d-70f7-4f08-9b2d-7c7e577f2c80"). InnerVolumeSpecName "kube-api-access-t494n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:24:54.057383 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:54.057294    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t494n\" (UniqueName: \"kubernetes.io/projected/940d8b2d-70f7-4f08-9b2d-7c7e577f2c80-kube-api-access-t494n\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:24:54.778910 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:54.772113    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54dea082ad6aced5ef08c2eee0ec900b7d090b30fdef6a6ebd6c742724d860ec"
Jul 10 17:24:54.778910 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:54.772115    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-139898138354352"
Jul 10 17:24:54.785700 ip-10-0-137-50 kubenswrapper[2574]: E0710 17:24:54.785665    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7504-139898138354352\" is forbidden: User \"system:node:ip-10-0-137-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-50.ec2.internal' and this object" podUID="940d8b2d-70f7-4f08-9b2d-7c7e577f2c80" pod="openshift-ingress/test-curl-7504-139898138354352"
Jul 10 17:24:55.867255 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:55.867221    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="940d8b2d-70f7-4f08-9b2d-7c7e577f2c80" path="/var/lib/kubelet/pods/940d8b2d-70f7-4f08-9b2d-7c7e577f2c80/volumes"
Jul 10 17:24:59.745607 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.745573    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7504-139898144299888"]
Jul 10 17:24:59.746034 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.746020    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940d8b2d-70f7-4f08-9b2d-7c7e577f2c80" containerName="test-curl-7504-139898138354352"
Jul 10 17:24:59.746081 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.746035    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="940d8b2d-70f7-4f08-9b2d-7c7e577f2c80" containerName="test-curl-7504-139898138354352"
Jul 10 17:24:59.746117 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.746101    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="940d8b2d-70f7-4f08-9b2d-7c7e577f2c80" containerName="test-curl-7504-139898138354352"
Jul 10 17:24:59.749023 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.749006    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-139898144299888"
Jul 10 17:24:59.751949 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.751920    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-dkfct\""
Jul 10 17:24:59.756349 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.756324    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-139898144299888"]
Jul 10 17:24:59.813198 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.813159    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb5kg\" (UniqueName: \"kubernetes.io/projected/ad7572af-38fd-4cb6-a959-8542999e5828-kube-api-access-mb5kg\") pod \"test-curl-7504-139898144299888\" (UID: \"ad7572af-38fd-4cb6-a959-8542999e5828\") " pod="openshift-ingress/test-curl-7504-139898144299888"
Jul 10 17:24:59.913802 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.913766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb5kg\" (UniqueName: \"kubernetes.io/projected/ad7572af-38fd-4cb6-a959-8542999e5828-kube-api-access-mb5kg\") pod \"test-curl-7504-139898144299888\" (UID: \"ad7572af-38fd-4cb6-a959-8542999e5828\") " pod="openshift-ingress/test-curl-7504-139898144299888"
Jul 10 17:24:59.923468 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:24:59.923434    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb5kg\" (UniqueName: \"kubernetes.io/projected/ad7572af-38fd-4cb6-a959-8542999e5828-kube-api-access-mb5kg\") pod \"test-curl-7504-139898144299888\" (UID: \"ad7572af-38fd-4cb6-a959-8542999e5828\") " pod="openshift-ingress/test-curl-7504-139898144299888"
Jul 10 17:25:00.059637 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:00.059557    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-139898144299888"
Jul 10 17:25:00.192083 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:00.192058    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7504-139898144299888"]
Jul 10 17:25:00.193924 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:25:00.193893    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad7572af_38fd_4cb6_a959_8542999e5828.slice/crio-cf31ec1760c2e037010ed8e02e1ea02434643332feb562010cd30ca7aa7d8bd9 WatchSource:0}: Error finding container cf31ec1760c2e037010ed8e02e1ea02434643332feb562010cd30ca7aa7d8bd9: Status 404 returned error can't find the container with id cf31ec1760c2e037010ed8e02e1ea02434643332feb562010cd30ca7aa7d8bd9
Jul 10 17:25:00.809822 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:00.809721    2574 generic.go:356] "Generic (PLEG): container finished" podID="ad7572af-38fd-4cb6-a959-8542999e5828" containerID="61732b876dce2dec5d0721e9282fbedcc1c28e8a3b6214df1732c7bd1d9faa55" exitCode=0
Jul 10 17:25:00.809822 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:00.809804    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-139898144299888" event={"ID":"ad7572af-38fd-4cb6-a959-8542999e5828","Type":"ContainerDied","Data":"61732b876dce2dec5d0721e9282fbedcc1c28e8a3b6214df1732c7bd1d9faa55"}
Jul 10 17:25:00.810245 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:00.809844    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7504-139898144299888" event={"ID":"ad7572af-38fd-4cb6-a959-8542999e5828","Type":"ContainerStarted","Data":"cf31ec1760c2e037010ed8e02e1ea02434643332feb562010cd30ca7aa7d8bd9"}
Jul 10 17:25:01.961033 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:01.961005    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-139898144299888"
Jul 10 17:25:01.981213 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:01.981184    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7504-139898144299888_ad7572af-38fd-4cb6-a959-8542999e5828/test-curl-7504-139898144299888/0.log"
Jul 10 17:25:02.006297 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:02.006257    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7504-139898144299888"]
Jul 10 17:25:02.012244 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:02.012216    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7504-139898144299888"]
Jul 10 17:25:02.033237 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:02.033210    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb5kg\" (UniqueName: \"kubernetes.io/projected/ad7572af-38fd-4cb6-a959-8542999e5828-kube-api-access-mb5kg\") pod \"ad7572af-38fd-4cb6-a959-8542999e5828\" (UID: \"ad7572af-38fd-4cb6-a959-8542999e5828\") "
Jul 10 17:25:02.035204 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:02.035172    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad7572af-38fd-4cb6-a959-8542999e5828-kube-api-access-mb5kg" (OuterVolumeSpecName: "kube-api-access-mb5kg") pod "ad7572af-38fd-4cb6-a959-8542999e5828" (UID: "ad7572af-38fd-4cb6-a959-8542999e5828"). InnerVolumeSpecName "kube-api-access-mb5kg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:25:02.135087 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:02.134998    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb5kg\" (UniqueName: \"kubernetes.io/projected/ad7572af-38fd-4cb6-a959-8542999e5828-kube-api-access-mb5kg\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:25:02.821114 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:02.821086    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf31ec1760c2e037010ed8e02e1ea02434643332feb562010cd30ca7aa7d8bd9"
Jul 10 17:25:02.821114 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:02.821100    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7504-139898144299888"
Jul 10 17:25:02.831223 ip-10-0-137-50 kubenswrapper[2574]: E0710 17:25:02.831193    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7504-139898144299888\" is forbidden: User \"system:node:ip-10-0-137-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-50.ec2.internal' and this object" podUID="ad7572af-38fd-4cb6-a959-8542999e5828" pod="openshift-ingress/test-curl-7504-139898144299888"
Jul 10 17:25:03.867649 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:03.867617    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad7572af-38fd-4cb6-a959-8542999e5828" path="/var/lib/kubelet/pods/ad7572af-38fd-4cb6-a959-8542999e5828/volumes"
Jul 10 17:25:04.995867 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:04.995823    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx" podUID="4d816f4e-b4a2-4523-9329-e10879ea2969" containerName="main" containerID="cri-o://4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a" gracePeriod=45
Jul 10 17:25:05.254308 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.254251    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:25:05.366781 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.366751    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-tmp-dir\") pod \"4d816f4e-b4a2-4523-9329-e10879ea2969\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") "
Jul 10 17:25:05.366781 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.366791    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-model-cache\") pod \"4d816f4e-b4a2-4523-9329-e10879ea2969\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") "
Jul 10 17:25:05.367039 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.366839    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-home\") pod \"4d816f4e-b4a2-4523-9329-e10879ea2969\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") "
Jul 10 17:25:05.367039 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.366870    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pfwv\" (UniqueName: \"kubernetes.io/projected/4d816f4e-b4a2-4523-9329-e10879ea2969-kube-api-access-8pfwv\") pod \"4d816f4e-b4a2-4523-9329-e10879ea2969\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") "
Jul 10 17:25:05.367039 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.366913    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d816f4e-b4a2-4523-9329-e10879ea2969-tls-certs\") pod \"4d816f4e-b4a2-4523-9329-e10879ea2969\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") "
Jul 10 17:25:05.367039 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.366982    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-dshm\") pod \"4d816f4e-b4a2-4523-9329-e10879ea2969\" (UID: \"4d816f4e-b4a2-4523-9329-e10879ea2969\") "
Jul 10 17:25:05.367235 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.367087    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4d816f4e-b4a2-4523-9329-e10879ea2969" (UID: "4d816f4e-b4a2-4523-9329-e10879ea2969"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:25:05.367235 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.367183    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-model-cache" (OuterVolumeSpecName: "model-cache") pod "4d816f4e-b4a2-4523-9329-e10879ea2969" (UID: "4d816f4e-b4a2-4523-9329-e10879ea2969"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:25:05.367235 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.367192    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-home" (OuterVolumeSpecName: "home") pod "4d816f4e-b4a2-4523-9329-e10879ea2969" (UID: "4d816f4e-b4a2-4523-9329-e10879ea2969"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:25:05.367396 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.367374    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-tmp-dir\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:25:05.367396 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.367388    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-model-cache\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:25:05.367478 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.367403    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-home\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:25:05.369192 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.369165    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-dshm" (OuterVolumeSpecName: "dshm") pod "4d816f4e-b4a2-4523-9329-e10879ea2969" (UID: "4d816f4e-b4a2-4523-9329-e10879ea2969"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 17:25:05.369192 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.369186    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d816f4e-b4a2-4523-9329-e10879ea2969-kube-api-access-8pfwv" (OuterVolumeSpecName: "kube-api-access-8pfwv") pod "4d816f4e-b4a2-4523-9329-e10879ea2969" (UID: "4d816f4e-b4a2-4523-9329-e10879ea2969"). InnerVolumeSpecName "kube-api-access-8pfwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 17:25:05.369340 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.369215    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d816f4e-b4a2-4523-9329-e10879ea2969-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4d816f4e-b4a2-4523-9329-e10879ea2969" (UID: "4d816f4e-b4a2-4523-9329-e10879ea2969"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 17:25:05.468424 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.468393    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d816f4e-b4a2-4523-9329-e10879ea2969-dshm\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:25:05.468424 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.468419    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pfwv\" (UniqueName: \"kubernetes.io/projected/4d816f4e-b4a2-4523-9329-e10879ea2969-kube-api-access-8pfwv\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:25:05.468621 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.468429    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d816f4e-b4a2-4523-9329-e10879ea2969-tls-certs\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:25:05.838055 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.838016    2574 generic.go:356] "Generic (PLEG): container finished" podID="4d816f4e-b4a2-4523-9329-e10879ea2969" containerID="4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a" exitCode=0
Jul 10 17:25:05.838227 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.838073    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"
Jul 10 17:25:05.838227 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.838104    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx" event={"ID":"4d816f4e-b4a2-4523-9329-e10879ea2969","Type":"ContainerDied","Data":"4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a"}
Jul 10 17:25:05.838227 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.838150    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx" event={"ID":"4d816f4e-b4a2-4523-9329-e10879ea2969","Type":"ContainerDied","Data":"5bcba8e50df4ec2bc3dd2c23fefe39f361898ef03cff6a7286e54e89d2217cd2"}
Jul 10 17:25:05.838227 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.838171    2574 scope.go:117] "RemoveContainer" containerID="4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a"
Jul 10 17:25:05.848128 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.848108    2574 scope.go:117] "RemoveContainer" containerID="4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a"
Jul 10 17:25:05.848748 ip-10-0-137-50 kubenswrapper[2574]: E0710 17:25:05.848725    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a\": container with ID starting with 4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a not found: ID does not exist" containerID="4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a"
Jul 10 17:25:05.848854 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.848761    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a"} err="failed to get container status \"4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a\": rpc error: code = NotFound desc = could not find container \"4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a\": container with ID starting with 4055bc77830831255797479fc1afb7fcec0d1e06c04f10f31926e57706a1a75a not found: ID does not exist"
Jul 10 17:25:05.860450 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.860416    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"]
Jul 10 17:25:05.867730 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:05.867706    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c9789a/rate-test-model-c9789a-kserve-7458bfd559-5svhx"]
Jul 10 17:25:07.867316 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.867272    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d816f4e-b4a2-4523-9329-e10879ea2969" path="/var/lib/kubelet/pods/4d816f4e-b4a2-4523-9329-e10879ea2969/volumes"
Jul 10 17:25:07.880898 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.880867    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"]
Jul 10 17:25:07.881367 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.881348    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad7572af-38fd-4cb6-a959-8542999e5828" containerName="test-curl-7504-139898144299888"
Jul 10 17:25:07.881477 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.881369    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad7572af-38fd-4cb6-a959-8542999e5828" containerName="test-curl-7504-139898144299888"
Jul 10 17:25:07.881477 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.881408    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d816f4e-b4a2-4523-9329-e10879ea2969" containerName="main"
Jul 10 17:25:07.881477 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.881416    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d816f4e-b4a2-4523-9329-e10879ea2969" containerName="main"
Jul 10 17:25:07.881634 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.881510    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d816f4e-b4a2-4523-9329-e10879ea2969" containerName="main"
Jul 10 17:25:07.881634 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.881524    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad7572af-38fd-4cb6-a959-8542999e5828" containerName="test-curl-7504-139898144299888"
Jul 10 17:25:07.886008 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.885987    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"
Jul 10 17:25:07.888863 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.888830    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m9lhw\""
Jul 10 17:25:07.891481 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.891454    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"]
Jul 10 17:25:07.994605 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:07.994566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4555e0-2c26-4175-bb4f-f35593d1d51d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d\" (UID: \"bd4555e0-2c26-4175-bb4f-f35593d1d51d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"
Jul 10 17:25:08.095711 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.095678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4555e0-2c26-4175-bb4f-f35593d1d51d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d\" (UID: \"bd4555e0-2c26-4175-bb4f-f35593d1d51d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"
Jul 10 17:25:08.096375 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.096354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4555e0-2c26-4175-bb4f-f35593d1d51d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d\" (UID: \"bd4555e0-2c26-4175-bb4f-f35593d1d51d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"
Jul 10 17:25:08.198525 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.198497    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"
Jul 10 17:25:08.330569 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.330534    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"]
Jul 10 17:25:08.334970 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:25:08.334940    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4555e0_2c26_4175_bb4f_f35593d1d51d.slice/crio-b1dc2bf025e64ce57c8561a8ebd9cd4fdaf1ceb9ad01dcfc7c169bbeaae44c3d WatchSource:0}: Error finding container b1dc2bf025e64ce57c8561a8ebd9cd4fdaf1ceb9ad01dcfc7c169bbeaae44c3d: Status 404 returned error can't find the container with id b1dc2bf025e64ce57c8561a8ebd9cd4fdaf1ceb9ad01dcfc7c169bbeaae44c3d
Jul 10 17:25:08.516140 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.516063    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:08.616755 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.616726    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:08.855872 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.855789    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d" event={"ID":"bd4555e0-2c26-4175-bb4f-f35593d1d51d","Type":"ContainerStarted","Data":"5412fa3f455f3a561d73dabc6764c627f81ed8f333ff9e6b76bb7f5e40486826"}
Jul 10 17:25:08.855872 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.855844    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d" event={"ID":"bd4555e0-2c26-4175-bb4f-f35593d1d51d","Type":"ContainerStarted","Data":"b1dc2bf025e64ce57c8561a8ebd9cd4fdaf1ceb9ad01dcfc7c169bbeaae44c3d"}
Jul 10 17:25:08.873008 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:08.872956    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d" podStartSLOduration=1.872940874 podStartE2EDuration="1.872940874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 17:25:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:25:08.870692063 +0000 UTC m=+2929.470867731" watchObservedRunningTime="2026-07-10 17:25:08.872940874 +0000 UTC m=+2929.473116529"
Jul 10 17:25:09.862842 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:09.862805    2574 generic.go:356] "Generic (PLEG): container finished" podID="bd4555e0-2c26-4175-bb4f-f35593d1d51d" containerID="5412fa3f455f3a561d73dabc6764c627f81ed8f333ff9e6b76bb7f5e40486826" exitCode=0
Jul 10 17:25:09.867293 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:09.867259    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d" event={"ID":"bd4555e0-2c26-4175-bb4f-f35593d1d51d","Type":"ContainerDied","Data":"5412fa3f455f3a561d73dabc6764c627f81ed8f333ff9e6b76bb7f5e40486826"}
Jul 10 17:25:11.003010 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:11.002985    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"
Jul 10 17:25:11.124378 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:11.124274    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4555e0-2c26-4175-bb4f-f35593d1d51d-maas-api-service-ca\") pod \"bd4555e0-2c26-4175-bb4f-f35593d1d51d\" (UID: \"bd4555e0-2c26-4175-bb4f-f35593d1d51d\") "
Jul 10 17:25:11.124644 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:11.124619    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4555e0-2c26-4175-bb4f-f35593d1d51d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bd4555e0-2c26-4175-bb4f-f35593d1d51d" (UID: "bd4555e0-2c26-4175-bb4f-f35593d1d51d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 17:25:11.225806 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:11.225768    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4555e0-2c26-4175-bb4f-f35593d1d51d-maas-api-service-ca\") on node \"ip-10-0-137-50.ec2.internal\" DevicePath \"\""
Jul 10 17:25:11.874232 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:11.874203    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d"
Jul 10 17:25:11.874409 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:11.874199    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d" event={"ID":"bd4555e0-2c26-4175-bb4f-f35593d1d51d","Type":"ContainerDied","Data":"b1dc2bf025e64ce57c8561a8ebd9cd4fdaf1ceb9ad01dcfc7c169bbeaae44c3d"}
Jul 10 17:25:11.874409 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:11.874319    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1dc2bf025e64ce57c8561a8ebd9cd4fdaf1ceb9ad01dcfc7c169bbeaae44c3d"
Jul 10 17:25:18.325672 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:18.325636    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:22.977536 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:22.977505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:29.013996 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:29.013952    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:29.119061 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:29.119023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:33.656842 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:33.656809    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:33.866228 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:33.866189    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:34.627949 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:34.627892    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:34.728737 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:34.728706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:44.462354 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:44.462243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:49.123793 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:49.123759    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:55.112359 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:55.112321    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:55.212585 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:55.212551    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:25:59.802837 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:25:59.802806    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:26:00.021403 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:00.021374    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:26:05.686154 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:05.686123    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d4859d9f6-7tzjj_8b45de2e-bcab-40f6-adf0-d446d1d925b7/manager/0.log"
Jul 10 17:26:06.077262 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:06.077184    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585db49996-6fst9_664bba24-ec88-47b0-bbda-9572797e0428/copy-manifests/0.log"
Jul 10 17:26:06.084924 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:06.084898    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585db49996-6fst9_664bba24-ec88-47b0-bbda-9572797e0428/manager/0.log"
Jul 10 17:26:06.723902 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:06.723868    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-86cd8d977b-b6879_360ea756-5e3b-4b4b-9031-d8f598531370/maas-api/0.log"
Jul 10 17:26:07.296413 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:07.296378    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-5e0f6f-hk7cn_e9902eb7-3626-41f6-8e27-69f713a87f3d/revoke-keys/0.log"
Jul 10 17:26:08.079360 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:08.079323    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-fd7cfb-vhh5d_bd4555e0-2c26-4175-bb4f-f35593d1d51d/revoke-keys/0.log"
Jul 10 17:26:08.305764 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:08.305734    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-6vrmz_f1e0075a-da8b-43f5-bece-7ec06613a5cd/postgres/0.log"
Jul 10 17:26:11.291447 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:11.291415    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5778d5b958-jcw74_bae91f70-d8ca-45a5-bcc6-d47c8a2476b8/kube-auth-proxy/0.log"
Jul 10 17:26:11.538211 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:11.538182    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pbnsc_7b26622e-d599-415c-8d70-197e2b6868f1/payload-pre-processing/0.log"
Jul 10 17:26:11.655559 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:11.655531    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k76hq_60c5fcd8-54d6-4492-a515-47c8a7bc28d8/payload-processing/0.log"
Jul 10 17:26:12.121099 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:12.121020    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2xs72_a7c29a48-6ea5-4607-a2d1-ef3a684fe9c5/main/0.log"
Jul 10 17:26:12.344511 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:12.344479    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-q2vfs_ca31e3dd-299a-40e9-8fa9-9ea306df7707/main/0.log"
Jul 10 17:26:12.459690 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:12.459655    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbc22p5_11df3a43-1026-405e-98db-351e3ebe7e55/main/0.log"
Jul 10 17:26:16.970062 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:16.970028    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:26:17.037204 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:17.037170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log" limit=1024
Jul 10 17:26:19.903555 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:19.903525    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sl5ck_f199d4f9-fbed-411d-ac9a-9fabecf00c50/global-pull-secret-syncer/0.log"
Jul 10 17:26:19.951454 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:19.951423    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mbx4l_3c40fe4a-2ee8-4a4f-8524-9fe0aa111da3/konnectivity-agent/0.log"
Jul 10 17:26:20.100485 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:20.100456    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-50.ec2.internal_5b19ef9cad8aadaa6a93113a3d0bf1d5/haproxy/0.log"
Jul 10 17:26:20.271383 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:20.271232    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:26:20.277029 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:20.277010    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:26:20.281369 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:20.281351    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:26:20.286813 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:20.286797    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bn486_2179c8ae-e467-4b7f-ab15-25c286eb1d3b/ovn-acl-logging/0.log"
Jul 10 17:26:26.696088 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:26.696053    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-wwbqt_20967626-d110-4b59-9396-ddb0e8f3fa23/cluster-monitoring-operator/0.log"
Jul 10 17:26:26.829942 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:26.829897    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-5v8k9_e703edd8-5444-4a89-a4c6-1c8f3700d00e/monitoring-plugin/0.log"
Jul 10 17:26:26.946013 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:26.945983    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsznp_c1e31e00-cdfd-45b4-821a-f2523774fc87/node-exporter/0.log"
Jul 10 17:26:26.969191 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:26.969163    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsznp_c1e31e00-cdfd-45b4-821a-f2523774fc87/kube-rbac-proxy/0.log"
Jul 10 17:26:26.994308 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:26.994283    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bsznp_c1e31e00-cdfd-45b4-821a-f2523774fc87/init-textfile/0.log"
Jul 10 17:26:27.231329 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.231247    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9889753-5d10-47c9-9c76-108a7d92ac63/prometheus/0.log"
Jul 10 17:26:27.259346 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.259324    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9889753-5d10-47c9-9c76-108a7d92ac63/config-reloader/0.log"
Jul 10 17:26:27.284622 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.284599    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9889753-5d10-47c9-9c76-108a7d92ac63/thanos-sidecar/0.log"
Jul 10 17:26:27.317701 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.317670    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9889753-5d10-47c9-9c76-108a7d92ac63/kube-rbac-proxy-web/0.log"
Jul 10 17:26:27.345267 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.345242    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9889753-5d10-47c9-9c76-108a7d92ac63/kube-rbac-proxy/0.log"
Jul 10 17:26:27.367315 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.367295    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9889753-5d10-47c9-9c76-108a7d92ac63/kube-rbac-proxy-thanos/0.log"
Jul 10 17:26:27.391678 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.391655    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b9889753-5d10-47c9-9c76-108a7d92ac63/init-config-reloader/0.log"
Jul 10 17:26:27.419402 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.419377    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-hfdrx_bef26fbf-d627-4cc6-8781-d5dff34e5343/prometheus-operator/0.log"
Jul 10 17:26:27.441075 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.441050    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-hfdrx_bef26fbf-d627-4cc6-8781-d5dff34e5343/kube-rbac-proxy/0.log"
Jul 10 17:26:27.510799 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.510728    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57cd54d986-r24tl_5931e130-ee92-4763-9982-525554d0a042/telemeter-client/0.log"
Jul 10 17:26:27.537018 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.536997    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57cd54d986-r24tl_5931e130-ee92-4763-9982-525554d0a042/reload/0.log"
Jul 10 17:26:27.563940 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.563914    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57cd54d986-r24tl_5931e130-ee92-4763-9982-525554d0a042/kube-rbac-proxy/0.log"
Jul 10 17:26:27.596121 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.596094    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6657868674-wz2bl_bc230930-738f-4f07-aeeb-08373626fbda/thanos-query/0.log"
Jul 10 17:26:27.620807 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.620781    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6657868674-wz2bl_bc230930-738f-4f07-aeeb-08373626fbda/kube-rbac-proxy-web/0.log"
Jul 10 17:26:27.642887 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.642864    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6657868674-wz2bl_bc230930-738f-4f07-aeeb-08373626fbda/kube-rbac-proxy/0.log"
Jul 10 17:26:27.666790 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.666766    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6657868674-wz2bl_bc230930-738f-4f07-aeeb-08373626fbda/prom-label-proxy/0.log"
Jul 10 17:26:27.689298 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.689276    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6657868674-wz2bl_bc230930-738f-4f07-aeeb-08373626fbda/kube-rbac-proxy-rules/0.log"
Jul 10 17:26:27.721783 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:27.721761    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6657868674-wz2bl_bc230930-738f-4f07-aeeb-08373626fbda/kube-rbac-proxy-metrics/0.log"
Jul 10 17:26:29.011759 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:29.011732    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-rwhkr_c595dc1c-3846-4b2a-a102-eaa6f7f02a6b/networking-console-plugin/0.log"
Jul 10 17:26:29.578300 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:29.578266    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/1.log"
Jul 10 17:26:29.583212 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:29.583192    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-bbclc_575c4bf2-e2ac-41e4-86c6-d5705cc47db6/console-operator/2.log"
Jul 10 17:26:30.204018 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.203977    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"]
Jul 10 17:26:30.204616 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.204593    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4555e0-2c26-4175-bb4f-f35593d1d51d" containerName="revoke-keys"
Jul 10 17:26:30.204714 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.204618    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4555e0-2c26-4175-bb4f-f35593d1d51d" containerName="revoke-keys"
Jul 10 17:26:30.204777 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.204766    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4555e0-2c26-4175-bb4f-f35593d1d51d" containerName="revoke-keys"
Jul 10 17:26:30.208035 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.208013    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.210809 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.210787    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bq8tx\"/\"openshift-service-ca.crt\""
Jul 10 17:26:30.212093 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.212077    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bq8tx\"/\"default-dockercfg-w74x2\""
Jul 10 17:26:30.212155 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.212101    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bq8tx\"/\"kube-root-ca.crt\""
Jul 10 17:26:30.216091 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.216067    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"]
Jul 10 17:26:30.362089 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.362056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-lib-modules\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.362285 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.362113    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-podres\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.362285 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.362180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdk7\" (UniqueName: \"kubernetes.io/projected/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-kube-api-access-wsdk7\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.362285 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.362222    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-sys\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.362285 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.362266    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-proc\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463621 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463537    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-podres\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463621 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdk7\" (UniqueName: \"kubernetes.io/projected/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-kube-api-access-wsdk7\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463621 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463606    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-sys\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463905 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-proc\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463905 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463715    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-podres\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463905 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463739    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-sys\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463905 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463778    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-lib-modules\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463905 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463807    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-proc\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.463905 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.463848    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-lib-modules\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.472394 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.472371    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdk7\" (UniqueName: \"kubernetes.io/projected/61bd4c8a-0322-463e-9b6e-5a2ffc6ef808-kube-api-access-wsdk7\") pod \"perf-node-gather-daemonset-p2qz6\" (UID: \"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808\") " pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.518696 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.518665    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:30.653266 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.653239    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"]
Jul 10 17:26:30.655287 ip-10-0-137-50 kubenswrapper[2574]: W0710 17:26:30.655259    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod61bd4c8a_0322_463e_9b6e_5a2ffc6ef808.slice/crio-124f3d0d1f1befd4a80a91f94892819635fa42b0159e200faaddc3502bb4ff12 WatchSource:0}: Error finding container 124f3d0d1f1befd4a80a91f94892819635fa42b0159e200faaddc3502bb4ff12: Status 404 returned error can't find the container with id 124f3d0d1f1befd4a80a91f94892819635fa42b0159e200faaddc3502bb4ff12
Jul 10 17:26:30.890412 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:30.890383    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-fnjr5_49d99475-2140-4169-84d3-27a7597390be/volume-data-source-validator/0.log"
Jul 10 17:26:31.282332 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:31.282297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6" event={"ID":"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808","Type":"ContainerStarted","Data":"a5951755ba11f5c543d430d32354fe123de2ff07c3cca9a4d76bbfbdd47dcc8f"}
Jul 10 17:26:31.282738 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:31.282360    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:31.282738 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:31.282381    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6" event={"ID":"61bd4c8a-0322-463e-9b6e-5a2ffc6ef808","Type":"ContainerStarted","Data":"124f3d0d1f1befd4a80a91f94892819635fa42b0159e200faaddc3502bb4ff12"}
Jul 10 17:26:31.301013 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:31.300963    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6" podStartSLOduration=1.300921575 podStartE2EDuration="1.300921575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 17:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 17:26:31.300272999 +0000 UTC m=+3011.900448654" watchObservedRunningTime="2026-07-10 17:26:31.300921575 +0000 UTC m=+3011.901097231"
Jul 10 17:26:31.959845 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:31.959818    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j2fhq_91942a10-f7ff-4dcd-935a-b55f45182a1d/dns/0.log"
Jul 10 17:26:31.983576 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:31.983548    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j2fhq_91942a10-f7ff-4dcd-935a-b55f45182a1d/kube-rbac-proxy/0.log"
Jul 10 17:26:32.088625 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:32.088600    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7f427_76c5f1d2-ca9e-44a3-9a36-aba1253886ee/dns-node-resolver/0.log"
Jul 10 17:26:32.756192 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:32.756166    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rbzv8_22f59fc7-5213-4c46-bb56-375112bb3e54/node-ca/0.log"
Jul 10 17:26:33.950907 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:33.950877    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5778d5b958-jcw74_bae91f70-d8ca-45a5-bcc6-d47c8a2476b8/kube-auth-proxy/0.log"
Jul 10 17:26:34.051388 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:34.051362    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pbnsc_7b26622e-d599-415c-8d70-197e2b6868f1/payload-pre-processing/0.log"
Jul 10 17:26:34.084024 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:34.083993    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k76hq_60c5fcd8-54d6-4492-a515-47c8a7bc28d8/payload-processing/0.log"
Jul 10 17:26:34.835149 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:34.835120    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tjchb_8a552c5e-c995-4240-ad1d-fd4c0b548e02/serve-healthcheck-canary/0.log"
Jul 10 17:26:35.347559 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:35.347524    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-pvc2q_c0ada96f-0a98-4af7-b788-799c1c27bf8d/insights-operator/0.log"
Jul 10 17:26:35.348018 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:35.347619    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-pvc2q_c0ada96f-0a98-4af7-b788-799c1c27bf8d/insights-operator/1.log"
Jul 10 17:26:35.449135 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:35.449106    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6vcp_a13da533-feef-4780-95e3-9c3b92b0682a/kube-rbac-proxy/0.log"
Jul 10 17:26:35.475762 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:35.475743    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6vcp_a13da533-feef-4780-95e3-9c3b92b0682a/exporter/0.log"
Jul 10 17:26:35.500099 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:35.500081    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6vcp_a13da533-feef-4780-95e3-9c3b92b0682a/extractor/0.log"
Jul 10 17:26:37.297619 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:37.297590    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bq8tx/perf-node-gather-daemonset-p2qz6"
Jul 10 17:26:38.089113 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:38.089083    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-d4859d9f6-7tzjj_8b45de2e-bcab-40f6-adf0-d446d1d925b7/manager/0.log"
Jul 10 17:26:38.237105 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:38.237077    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585db49996-6fst9_664bba24-ec88-47b0-bbda-9572797e0428/manager/0.log"
Jul 10 17:26:38.259207 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:38.259185    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-585db49996-6fst9_664bba24-ec88-47b0-bbda-9572797e0428/copy-manifests/0.log"
Jul 10 17:26:39.827259 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:39.827230    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-655c89f56d-jm5wn_772d1a8f-0f43-4cac-ac4e-5f5023a71f32/manager/0.log"
Jul 10 17:26:40.151730 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:40.151704    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5778d5b958-jcw74_bae91f70-d8ca-45a5-bcc6-d47c8a2476b8/kube-auth-proxy/0.log"
Jul 10 17:26:40.256317 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:40.256286    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pbnsc_7b26622e-d599-415c-8d70-197e2b6868f1/payload-pre-processing/0.log"
Jul 10 17:26:40.283358 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:40.283331    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k76hq_60c5fcd8-54d6-4492-a515-47c8a7bc28d8/payload-processing/0.log"
Jul 10 17:26:41.832631 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:41.832601    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5778d5b958-jcw74_bae91f70-d8ca-45a5-bcc6-d47c8a2476b8/kube-auth-proxy/0.log"
Jul 10 17:26:41.911218 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:41.911187    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pbnsc_7b26622e-d599-415c-8d70-197e2b6868f1/payload-pre-processing/0.log"
Jul 10 17:26:41.932360 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:41.932329    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k76hq_60c5fcd8-54d6-4492-a515-47c8a7bc28d8/payload-processing/0.log"
Jul 10 17:26:44.948953 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:44.948897    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xwlgp_a0e14a6d-220e-4750-948a-9595fab9b123/migrator/0.log"
Jul 10 17:26:44.969997 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:44.969966    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xwlgp_a0e14a6d-220e-4750-948a-9595fab9b123/graceful-termination/0.log"
Jul 10 17:26:46.647330 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:46.647306    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvkht_88d91a45-22a3-45f0-b800-125650e7d68b/kube-multus-additional-cni-plugins/0.log"
Jul 10 17:26:46.671688 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:46.671663    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvkht_88d91a45-22a3-45f0-b800-125650e7d68b/egress-router-binary-copy/0.log"
Jul 10 17:26:46.693501 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:46.693477    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvkht_88d91a45-22a3-45f0-b800-125650e7d68b/cni-plugins/0.log"
Jul 10 17:26:46.717520 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:46.717496    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvkht_88d91a45-22a3-45f0-b800-125650e7d68b/bond-cni-plugin/0.log"
Jul 10 17:26:46.740693 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:46.740671    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvkht_88d91a45-22a3-45f0-b800-125650e7d68b/routeoverride-cni/0.log"
Jul 10 17:26:46.763219 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:46.763191    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvkht_88d91a45-22a3-45f0-b800-125650e7d68b/whereabouts-cni-bincopy/0.log"
Jul 10 17:26:46.785796 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:46.785774    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tvkht_88d91a45-22a3-45f0-b800-125650e7d68b/whereabouts-cni/0.log"
Jul 10 17:26:46.857679 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:46.857653    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wlr8h_d2573b8a-2be3-4ba0-9b55-6848ae4f91f8/kube-multus/0.log"
Jul 10 17:26:47.018521 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:47.018448    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qlswx_6df769b8-14bb-4309-b135-f356e95f75e1/network-metrics-daemon/0.log"
Jul 10 17:26:47.040436 ip-10-0-137-50 kubenswrapper[2574]: I0710 17:26:47.040407    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qlswx_6df769b8-14bb-4309-b135-f356e95f75e1/kube-rbac-proxy/0.log"