Jul 28 17:20:44.192595 ip-10-0-142-249 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 17:20:44.192607 ip-10-0-142-249 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 17:20:44.192614 ip-10-0-142-249 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 17:20:44.192908 ip-10-0-142-249 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 17:20:53.287756 ip-10-0-142-249 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 17:20:53.287770 ip-10-0-142-249 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 92413817b11c499eb724e4ced90a13b0 --
Jul 28 17:22:24.305948 ip-10-0-142-249 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 17:22:24.706532 ip-10-0-142-249 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:22:24.706532 ip-10-0-142-249 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 17:22:24.706532 ip-10-0-142-249 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:22:24.706532 ip-10-0-142-249 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 17:22:24.706532 ip-10-0-142-249 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 17:22:24.707223 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.706555    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 17:22:24.712042 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712018    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:22:24.712042 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712041    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:22:24.712042 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712045    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712049    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712052    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712056    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712059    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712062    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712065    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712067    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712070    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712073    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712077    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712079    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712082    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712085    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712088    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712090    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712093    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712100    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712104    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712107    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:22:24.712148 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712109    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712112    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712115    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712117    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712120    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712122    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712125    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712128    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712131    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712134    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712136    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712139    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712142    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712145    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712148    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712151    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712154    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712157    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712159    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712162    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:22:24.712648 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712164    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712167    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712170    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712172    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712175    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712177    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712180    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712183    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712186    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712189    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712191    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712194    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712196    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712200    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712203    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712206    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712208    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712213    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712216    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:22:24.713147 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712219    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712221    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712224    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712227    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712229    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712232    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712235    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712241    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712245    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712248    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712251    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712253    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712256    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712260    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712262    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712265    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712268    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712271    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712274    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:22:24.713671 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712279    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712281    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712284    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712287    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712289    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712292    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712294    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712297    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712300    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712304    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712307    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712310    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712314    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712317    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712320    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712323    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712325    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712328    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.712331    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:22:24.714143 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713136    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713143    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713146    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713151    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713156    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713159    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713162    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713165    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713168    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713170    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713173    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713176    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713179    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713182    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713185    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713187    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713190    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713193    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713196    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:22:24.714627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713198    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713201    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713204    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713207    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713209    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713212    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713215    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713218    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713220    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713223    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713225    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713228    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713231    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713233    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713236    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713238    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713241    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713243    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713246    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713248    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:22:24.715109 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713251    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713253    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713257    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713259    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713262    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713264    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713267    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713269    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713273    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713275    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713278    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713280    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713283    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713285    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713288    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713291    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713293    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713296    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713299    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:22:24.715618 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713301    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713304    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713306    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713309    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713312    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713315    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713318    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713320    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713323    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713325    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713328    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713330    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713340    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713343    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713347    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713350    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713353    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713356    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713359    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:22:24.716178 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713361    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713365    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713368    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713371    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713373    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713376    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713379    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713381    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713384    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713387    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713391    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713398    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713401    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713404    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713406    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713409    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713412    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713414    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713417    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713420    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:22:24.716678 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713423    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713425    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713856    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713862    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713865    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713868    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713872    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713876    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713879    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713883    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713886    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713890    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713893    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713896    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713899    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713903    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713906    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713909    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713911    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:22:24.717172 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713914    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713916    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713920    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713923    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713927    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713930    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713932    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713935    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713937    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713940    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713943    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713946    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713948    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713951    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713954    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713956    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713959    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713962    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713964    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713966    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:22:24.717649 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713969    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713972    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713974    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713976    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713979    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713982    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713985    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713987    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713990    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713995    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.713998    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714000    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714003    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714005    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714008    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714010    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714013    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714017    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714020    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714022    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:22:24.718151 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714025    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714028    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714030    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714032    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714035    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714037    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714040    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714043    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714045    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714048    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714050    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714053    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714056    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714059    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714061    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714064    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714066    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714069    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714072    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714075    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:22:24.718707 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714077    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714081    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714084    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714087    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714090    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714093    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714095    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714098    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714101    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714103    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714106    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714108    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714113    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714116    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714119    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714122    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714125    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714128    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714131    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:22:24.719189 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714134    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714136    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714139    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714223    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714232    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714239    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714244    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714249    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714252    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714257    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714261    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714265    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714268    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714271    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714276    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714279    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714284    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714287    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714290    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714293    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714296    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714300    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714303    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714306    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 17:22:24.719673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714310    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714313    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714317    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714320    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714323    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714326    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714330    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714333    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714336    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714340    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714343    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714347    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714350    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714353    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714356    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714360    2573 flags.go:64] FLAG: --enable-server="true"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714363    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714368    2573 flags.go:64] FLAG: --event-burst="100"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714371    2573 flags.go:64] FLAG: --event-qps="50"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714374    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714377    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714380    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714386    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714389    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714392    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 17:22:24.720246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714396    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714399    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714402    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714405    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714410    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714413    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714416    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714428    2573 flags.go:64] FLAG: --feature-gates=""
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714433    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714436    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714439    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714443    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714446    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714450    2573 flags.go:64] FLAG: --help="false"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714453    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-142-249.ec2.internal"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714456    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714459    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714462    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714466    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714470    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714473    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714475    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714478    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 17:22:24.720903 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714481    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714484    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714487    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714490    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714493    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714496    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714501    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714504    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714507    2573 flags.go:64] FLAG: --lock-file=""
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714510    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714514    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714517    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714523    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714528    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714531    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714534    2573 flags.go:64] FLAG: --logging-format="text"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714537    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714540    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714543    2573 flags.go:64] FLAG: --manifest-url=""
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714546    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714551    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714554    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714558    2573 flags.go:64] FLAG: --max-pods="110"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714561    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714565    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 17:22:24.721506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714567    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714571    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714574    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714577    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714580    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714587    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714591    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714594    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714597    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714599    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714606    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714623    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714627    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714630    2573 flags.go:64] FLAG: --port="10250"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714634    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714638    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01b42a2b9e3915d58"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714641    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714644    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714648    2573 flags.go:64] FLAG: --register-node="true"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714651    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714657    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714660    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714663    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714666    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714669    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 17:22:24.722191 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714673    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714676    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714679    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714682    2573 flags.go:64] FLAG: --runonce="false"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714685    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714688    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714692    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714695    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714698    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714702    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714705    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714708    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714711    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714714    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714717    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714720    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714723    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714727    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714729    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714735    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714738    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714744    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714748    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714751    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714754    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 17:22:24.722835 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714757    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714760    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714765    2573 flags.go:64] FLAG: --v="2"
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714769    2573 flags.go:64] FLAG: --version="false"
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714773    2573 flags.go:64] FLAG: --vmodule=""
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714777    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.714780    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714898    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714902    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714906    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714909    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714912    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714915    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714918    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714921    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714924    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714927    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714930    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714932    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714935    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714938    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:22:24.723460 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714941    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714943    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714946    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714948    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714951    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714953    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714956    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714960    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714963    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714966    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714968    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714971    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714973    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714979    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714983    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714987    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714990    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714993    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714996    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.714999    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:22:24.724000 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715002    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715005    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715008    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715010    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715013    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715016    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715019    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715021    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715024    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715026    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715029    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715032    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715034    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715038    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715042    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715045    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715047    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715050    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715052    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715056    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:22:24.724517 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715059    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715061    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715064    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715067    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715070    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715074    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715077    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715079    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715082    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715085    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715087    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715090    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715092    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715095    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715097    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715100    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715103    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715106    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715110    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:22:24.725033 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715113    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715116    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715119    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715122    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715124    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715128    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715131    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715133    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715136    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715138    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715141    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715144    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715148    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715150    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715153    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715155    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715158    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715161    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715165    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715167    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:22:24.725507 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715170    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715173    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715176    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715179    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715182    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.715184    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.715190    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.722479    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.722508    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.722535    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.722548    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722629    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722635    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722638    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:22:24.726127 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722642    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722645    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722647    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722650    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722653    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722657    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722661    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722664    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722667    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722670    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722673    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722675    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722679    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722682    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722685    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722688    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722692    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722696    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722700    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:22:24.726494 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722703    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722706    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722709    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722712    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722715    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722718    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722721    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722730    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722734    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722737    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722740    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722743    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722746    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722748    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722751    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722755    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722758    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722761    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722764    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:22:24.726971 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722767    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722769    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722772    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722775    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722778    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722781    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722783    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722786    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722789    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722792    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722794    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722797    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722800    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722803    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722805    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722808    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722811    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722813    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722816    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722818    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:22:24.727448 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722821    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722829    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722832    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722835    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722838    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722840    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722843    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722846    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722848    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722851    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722854    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722857    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722860    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722862    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722865    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722868    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722870    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722872    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722875    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722878    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:22:24.728002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722880    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722883    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722886    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722889    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722891    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722894    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722897    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722899    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722902    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722905    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722908    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722911    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722913    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722916    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722925    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722928    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722931    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:22:24.728499 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.722933    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.722939    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723111    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723117    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723120    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723123    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723126    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723129    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723131    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723134    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723136    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723139    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723141    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723144    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723146    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 17:22:24.728941 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723149    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723151    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723154    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723157    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723160    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723163    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723167    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723170    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723173    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723176    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723179    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723182    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723186    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723189    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723191    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723200    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723204    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723206    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723209    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 17:22:24.729320 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723212    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723215    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723218    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723220    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723224    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723226    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723229    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723232    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723234    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723237    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723239    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723242    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723244    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723247    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723250    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723252    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723255    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723257    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723260    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723263    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 17:22:24.729930 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723266    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723270    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723273    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723275    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723278    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723281    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723283    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723286    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723289    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723298    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723302    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723305    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723308    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723311    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723313    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723316    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723319    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723322    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723324    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 17:22:24.730428 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723326    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723329    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723332    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723334    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723337    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723339    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723342    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723344    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723347    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723349    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723352    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723354    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723357    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723360    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723362    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723365    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723367    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723370    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723373    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723375    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 17:22:24.730918 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723378    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723380    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723383    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723391    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723394    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723396    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723399    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:24.723401    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.723406    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.723568    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.725730    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.727335    2573 server.go:1019] "Starting client certificate rotation"
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.727439    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:22:24.731679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.727472    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 17:22:24.733095 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.733064    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:22:24.734275 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.734251    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 17:22:24.744247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.744225    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 28 17:22:24.747979 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.747961    2573 log.go:25] "Validated CRI v1 image API"
Jul 28 17:22:24.748913 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.748893    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 17:22:24.751435 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.751408    2573 fs.go:135] Filesystem UUIDs: map[350ca918-7eee-40fe-aa7b-c0c9e89a7e82:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d094ad09-fe79-4570-ab1c-b3d10689c1da:/dev/nvme0n1p4]
Jul 28 17:22:24.751496 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.751433    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 17:22:24.757371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.757235    2573 manager.go:216] Machine: {Timestamp:2026-07-28 17:22:24.755873171 +0000 UTC m=+0.333468039 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100267 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24133a81ebafd769aa0eff7b103fcc SystemUUID:ec24133a-81eb-afd7-69aa-0eff7b103fcc BootID:92413817-b11c-499e-b724-e4ced90a13b0 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:a2:f1:53:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:a2:f1:53:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:bd:a5:6e:13:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 17:22:24.757371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.757360    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 17:22:24.757515 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.757503    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 17:22:24.758877 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.758859    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:22:24.760881 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.760846    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 17:22:24.761080 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.760888    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 17:22:24.761794 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.761781    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 17:22:24.761847 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.761798    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 17:22:24.761847 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.761809    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:22:24.762496 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.762482    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 17:22:24.763737 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.763723    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 17:22:24.766743 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.766726    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:22:24.766916 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.766904    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 17:22:24.766983 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.766959    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 17:22:24.766983 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.766975    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 17:22:24.767074 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.767009    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 17:22:24.767074 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.767024    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 28 17:22:24.767074 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.767036    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 17:22:24.767883 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.767857    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:22:24.767883 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.767887    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 17:22:24.770131 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.770099    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 17:22:24.773124 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.773102    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 17:22:24.773199 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.773148    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 17:22:24.774667 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774653    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 17:22:24.774714 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774674    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 17:22:24.774714 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774680    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 17:22:24.774714 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774686    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 17:22:24.774714 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774694    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 17:22:24.774714 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774699    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 17:22:24.774714 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774710    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 17:22:24.774883 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774719    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 17:22:24.774883 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774729    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 17:22:24.774883 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774734    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 17:22:24.774883 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774748    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 17:22:24.774883 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.774754    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 17:22:24.775525 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.775513    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 17:22:24.775555 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.775527    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 17:22:24.779530 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.779502    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 17:22:24.779530 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.779513    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 17:22:24.779530 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.779529    2573 server.go:1268] "Started kubelet"
Jul 28 17:22:24.779760 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.779685    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 17:22:24.779760 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.779674    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 17:22:24.779760 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.779701    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 17:22:24.779760 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.779748    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 17:22:24.780477 ip-10-0-142-249 systemd[1]: Started Kubernetes Kubelet.
Jul 28 17:22:24.781667 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.781651    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 17:22:24.781884 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.781866    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 17:22:24.786246 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.786225    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 17:22:24.788590 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.787662    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea558742a6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.779494054 +0000 UTC m=+0.357088957,LastTimestamp:2026-07-28 17:22:24.779494054 +0000 UTC m=+0.357088957,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.788895 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.788880    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 17:22:24.788895 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.788890    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 17:22:24.789122 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.789103    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:24.789504 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.789483    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 17:22:24.789599 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.789531    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 17:22:24.789599 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.789483    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 17:22:24.789752 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.789737    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 17:22:24.789752 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.789750    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 17:22:24.789977 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.789956    2573 factory.go:55] Registering systemd factory
Jul 28 17:22:24.790048 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.789982    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 28 17:22:24.790222 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.790208    2573 factory.go:153] Registering CRI-O factory
Jul 28 17:22:24.790222 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.790223    2573 factory.go:223] Registration of the crio container factory successfully
Jul 28 17:22:24.790344 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.790328    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 17:22:24.790395 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.790351    2573 factory.go:103] Registering Raw factory
Jul 28 17:22:24.790395 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.790364    2573 manager.go:1196] Started watching for new ooms in manager
Jul 28 17:22:24.790724 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.790713    2573 manager.go:349] Starting recovery of all containers
Jul 28 17:22:24.796348 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.796311    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 17:22:24.796529 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.796413    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 17:22:24.797978 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.797957    2573 manager.go:354] Recovery completed
Jul 28 17:22:24.806489 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.806469    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:24.809550 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.809509    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:24.809649 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.809561    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:24.809649 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.809576    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:24.810229 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.810210    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 17:22:24.810229 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.810225    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:24.810388 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.810225    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 17:22:24.810388 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.810325    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 17:22:24.811556 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.811541    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:24.811664 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.811569    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:24.811664 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.811582    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:24.811829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.811767    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lwb97"
Jul 28 17:22:24.812039 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.811957    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea5751c3fd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-249.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.809542653 +0000 UTC m=+0.387137532,LastTimestamp:2026-07-28 17:22:24.809542653 +0000 UTC m=+0.387137532,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.813509 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.813495    2573 policy_none.go:49] "None policy: Start"
Jul 28 17:22:24.813564 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.813513    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 17:22:24.813564 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.813525    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 17:22:24.814823 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.814808    2573 policy_none.go:47] "Start"
Jul 28 17:22:24.819384 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.819362    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lwb97"
Jul 28 17:22:24.820470 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.820383    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea575225d1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-249.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.809567697 +0000 UTC m=+0.387162568,LastTimestamp:2026-07-28 17:22:24.809567697 +0000 UTC m=+0.387162568,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.823432 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.823336    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea57525c99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-249.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.809581721 +0000 UTC m=+0.387176592,LastTimestamp:2026-07-28 17:22:24.809581721 +0000 UTC m=+0.387176592,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.830168 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.830099    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-249.ec2.internal.18c683ea5751c3fd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea5751c3fd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-249.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.809542653 +0000 UTC m=+0.387137532,LastTimestamp:2026-07-28 17:22:24.811556571 +0000 UTC m=+0.389151440,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.834719 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.834643    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-249.ec2.internal.18c683ea575225d1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea575225d1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-249.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.809567697 +0000 UTC m=+0.387162568,LastTimestamp:2026-07-28 17:22:24.811574424 +0000 UTC m=+0.389169292,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.838307 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.838212    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-249.ec2.internal.18c683ea57525c99\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea57525c99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-249.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.809581721 +0000 UTC m=+0.387176592,LastTimestamp:2026-07-28 17:22:24.811587347 +0000 UTC m=+0.389182218,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.842433 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.842411    2573 manager.go:337] "Starting Device Plugin manager"
Jul 28 17:22:24.842525 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.842456    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 17:22:24.842525 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.842469    2573 server.go:87] "Starting device plugin registration server"
Jul 28 17:22:24.842812 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.842776    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 17:22:24.842812 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.842788    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.842972    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.843040    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.843048    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.843660    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.843701    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.854493    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea59dbe8b5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.852150453 +0000 UTC m=+0.429745314,LastTimestamp:2026-07-28 17:22:24.852150453 +0000 UTC m=+0.429745314,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.892972    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.894226    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.894261    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.894286    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.894331    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.904259    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.943367    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.944402    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.944436    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.944448    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.944472    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-249.ec2.internal"
Jul 28 17:22:24.957446 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.954742    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-249.ec2.internal.18c683ea5751c3fd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-249.ec2.internal.18c683ea5751c3fd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-249.ec2.internal,UID:ip-10-0-142-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-249.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-249.ec2.internal,},FirstTimestamp:2026-07-28 17:22:24.809542653 +0000 UTC m=+0.387137532,LastTimestamp:2026-07-28 17:22:24.944419244 +0000 UTC m=+0.522014113,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-249.ec2.internal,}"
Jul 28 17:22:24.965428 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:24.965401    2573 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-249.ec2.internal\" not found" node="ip-10-0-142-249.ec2.internal"
Jul 28 17:22:24.995139 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.995098    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"]
Jul 28 17:22:24.995280 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.995178    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:24.996849 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.996825    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:24.996955 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.996860    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:24.996955 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.996873    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:24.998226 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.998213    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:24.998340 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.998326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:24.998424 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.998355    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:24.998970 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.998955    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:24.999037 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.998979    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:24.999037 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.998990    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:24.999037 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.998959    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:24.999128 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.999049    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:24.999128 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:24.999059    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:25.000163 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.000148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.000216 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.000198    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:25.000958 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.000942    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:25.001038 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.000975    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:25.001038 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.000989    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:25.002542 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.002526    2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-249.ec2.internal\" not found" node="ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.026688 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.026659    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-249.ec2.internal\" not found" node="ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.031204 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.031185    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-249.ec2.internal\" not found" node="ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.091034 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.090852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c25493469be6db5c640ec763bc3a85a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"c25493469be6db5c640ec763bc3a85a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.091178 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.091042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/146ec1ace48114f74bcbf562afadcc12-config\") pod \"kube-apiserver-proxy-ip-10-0-142-249.ec2.internal\" (UID: \"146ec1ace48114f74bcbf562afadcc12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.091178 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.091062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c25493469be6db5c640ec763bc3a85a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"c25493469be6db5c640ec763bc3a85a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.166013 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.165971    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:25.167988 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.167969    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:25.168090 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.168003    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:25.168090 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.168014    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:25.168090 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.168045    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.177973 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.177954    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.178045 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.177979    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-249.ec2.internal\": node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.192116 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.192097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/146ec1ace48114f74bcbf562afadcc12-config\") pod \"kube-apiserver-proxy-ip-10-0-142-249.ec2.internal\" (UID: \"146ec1ace48114f74bcbf562afadcc12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.192190 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.192121    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c25493469be6db5c640ec763bc3a85a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"c25493469be6db5c640ec763bc3a85a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.192190 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.192139    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c25493469be6db5c640ec763bc3a85a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"c25493469be6db5c640ec763bc3a85a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.192190 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.192179    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c25493469be6db5c640ec763bc3a85a7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"c25493469be6db5c640ec763bc3a85a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.192285 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.192202    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/146ec1ace48114f74bcbf562afadcc12-config\") pod \"kube-apiserver-proxy-ip-10-0-142-249.ec2.internal\" (UID: \"146ec1ace48114f74bcbf562afadcc12\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.192285 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.192202    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c25493469be6db5c640ec763bc3a85a7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal\" (UID: \"c25493469be6db5c640ec763bc3a85a7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.210245 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.210189    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.311119 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.311089    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.329257 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.329230    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.334500 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.334430    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:25.411798 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.411751    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.512367 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.512266    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.612708 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.612668    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.713728 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.713681    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.726833 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.726801    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 17:22:25.815319 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.815250    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.851229 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.851206    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:22:25.915874 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:25.915838    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-249.ec2.internal\" not found"
Jul 28 17:22:25.954156 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:25.954112    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25493469be6db5c640ec763bc3a85a7.slice/crio-9d4aaab612a152dd12728d12ce2b3d0a7addc2029d5c9f1c0df86ab421c3a9ed WatchSource:0}: Error finding container 9d4aaab612a152dd12728d12ce2b3d0a7addc2029d5c9f1c0df86ab421c3a9ed: Status 404 returned error can't find the container with id 9d4aaab612a152dd12728d12ce2b3d0a7addc2029d5c9f1c0df86ab421c3a9ed
Jul 28 17:22:25.955038 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:25.955009    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146ec1ace48114f74bcbf562afadcc12.slice/crio-573ba5faba7b4399c7dc47b3a1104bf977c5ef3057858c8dc48db665162a1f6f WatchSource:0}: Error finding container 573ba5faba7b4399c7dc47b3a1104bf977c5ef3057858c8dc48db665162a1f6f: Status 404 returned error can't find the container with id 573ba5faba7b4399c7dc47b3a1104bf977c5ef3057858c8dc48db665162a1f6f
Jul 28 17:22:25.960167 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.960143    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:22:25.960864 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.960828    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 17:22:25.960971 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.960794    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 17:17:25 +0000 UTC" deadline="2028-04-18 21:19:14.36685889 +0000 UTC"
Jul 28 17:22:25.960971 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.960899    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15123h56m48.40596785s"
Jul 28 17:22:25.962634 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.962614    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 17:22:25.962728 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.962651    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 17:22:25.962728 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:25.962668    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeHasSufficientPID"
Jul 28 17:22:26.015203 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.015171    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:22:26.092441 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.092338    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:26.100056 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.100026    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:22:26.106926 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.106900    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:22:26.108348 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.108330    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"
Jul 28 17:22:26.118003 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.117979    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 17:22:26.387762 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.387683    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 17:22:26.769504 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.769402    2573 apiserver.go:52] "Watching apiserver"
Jul 28 17:22:26.777439 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.777391    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 17:22:26.777887 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.777855    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-rhtqf","openshift-dns/node-resolver-phdpq","openshift-image-registry/node-ca-86vmd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal","openshift-multus/multus-rdwl9","openshift-network-diagnostics/network-check-target-7lpnq","kube-system/konnectivity-agent-fjn2t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf","openshift-multus/multus-additional-cni-plugins-7cljj","openshift-multus/network-metrics-daemon-jzkgz","openshift-network-operator/iptables-alerter-btq7g","openshift-ovn-kubernetes/ovnkube-node-gglbf","kube-system/global-pull-secret-syncer-rzmd7","kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal"]
Jul 28 17:22:26.779990 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.779941    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:26.780123 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:26.780072    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:26.781730 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.781708    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:26.782945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.782922    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.784600 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.784505    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 17:22:26.785679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.784810    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 17:22:26.785679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.784860    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n7j44\""
Jul 28 17:22:26.785679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.785084    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 17:22:26.785679 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.785433    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.786279 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.786257    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 17:22:26.786370 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.786343    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 17:22:26.786421 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.786392    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7x44p\""
Jul 28 17:22:26.787105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.787079    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.787873 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.787848    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 17:22:26.788294 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.787853    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 17:22:26.788464 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.788423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.788566 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:26.788493    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:26.789451 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.788872    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 17:22:26.789451 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.788929    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 17:22:26.789451 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.788937    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52j9s\""
Jul 28 17:22:26.789451 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.789260    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 17:22:26.789451 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.789343    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 17:22:26.789988 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.789968    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 17:22:26.790222 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.790203    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 17:22:26.790470 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.790451    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 17:22:26.790677 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.790658    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 17:22:26.790779 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.790705    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 17:22:26.790779 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.790734    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hldxt\""
Jul 28 17:22:26.791185 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.791157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.792908 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.792888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:26.793011 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:26.792963    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:26.793654 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.793633    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hn7jw\""
Jul 28 17:22:26.793960 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.793941    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 17:22:26.794348 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.794328    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 17:22:26.794457 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.794438    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:26.796155 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.796102    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.797059 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.797039    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 17:22:26.797264 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.797247    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 17:22:26.797510 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.797490    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cfbqm\""
Jul 28 17:22:26.798184 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.798165    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:26.801659 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.801254    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-55rpk\""
Jul 28 17:22:26.801659 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.801275    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:22:26.801659 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.801492    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.801907    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-system-cni-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.801990    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02df3d99-6357-4957-a7d5-3734ffd68714-agent-certs\") pod \"konnectivity-agent-fjn2t\" (UID: \"02df3d99-6357-4957-a7d5-3734ffd68714\") " pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-kubelet\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802077    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-socket-dir-parent\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802153    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-system-cni-dir\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802202    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6df1c290-c341-40cc-9644-82a9a471aa55-serviceca\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802231    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-systemd\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802295    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-cnibin\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-cni-binary-copy\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-etc-kubernetes\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802872    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-systemd-units\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802903    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-etc-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-log-socket\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-env-overrides\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.804251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.802997    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9688db4-1f96-436c-8543-1d8b36b15713-ovn-node-metrics-cert\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-hostroot\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwp4\" (UniqueName: \"kubernetes.io/projected/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-kube-api-access-hfwp4\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-var-lib-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-ovnkube-config\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-cni-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803237    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pbnh\" (UniqueName: \"kubernetes.io/projected/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-kube-api-access-6pbnh\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8xh5\" (UniqueName: \"kubernetes.io/projected/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-kube-api-access-n8xh5\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803343    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803351    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803345    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6df1c290-c341-40cc-9644-82a9a471aa55-host\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-ovnkube-script-lib\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-kubelet\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-daemon-config\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803540    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-multus-certs\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.805244 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-run-netns\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cnibin\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02df3d99-6357-4957-a7d5-3734ffd68714-konnectivity-ca\") pod \"konnectivity-agent-fjn2t\" (UID: \"02df3d99-6357-4957-a7d5-3734ffd68714\") " pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803731    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-cni-multus\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803748    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-cni-bin\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp5ck\" (UniqueName: \"kubernetes.io/projected/a9688db4-1f96-436c-8543-1d8b36b15713-kube-api-access-pp5ck\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-node-log\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-run-ovn-kubernetes\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.803986    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-os-release\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-cni-netd\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804057    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-slash\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804089    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-os-release\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804113    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rpt4q\""
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-netns\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-cni-bin\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.806119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-conf-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804487    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b791044-ec01-4361-a7af-94b280ecf848-kubelet-config\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804579    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-ovn\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-k8s-cni-cncf-io\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gjkk\" (UniqueName: \"kubernetes.io/projected/6df1c290-c341-40cc-9644-82a9a471aa55-kube-api-access-6gjkk\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b791044-ec01-4361-a7af-94b280ecf848-dbus\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.804777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.806244    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 17:22:26.807105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.806390    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 17:22:26.808358 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.808334    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 17:22:26.808562 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.808542    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 17:22:26.808639 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.808568    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lgs4h\""
Jul 28 17:22:26.832873 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.832840    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h42jz"
Jul 28 17:22:26.842640 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.842611    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h42jz"
Jul 28 17:22:26.891688 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.891659    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 17:22:26.900682 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.900598    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" event={"ID":"146ec1ace48114f74bcbf562afadcc12","Type":"ContainerStarted","Data":"573ba5faba7b4399c7dc47b3a1104bf977c5ef3057858c8dc48db665162a1f6f"}
Jul 28 17:22:26.902112 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.902074    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" event={"ID":"c25493469be6db5c640ec763bc3a85a7","Type":"ContainerStarted","Data":"9d4aaab612a152dd12728d12ce2b3d0a7addc2029d5c9f1c0df86ab421c3a9ed"}
Jul 28 17:22:26.905432 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905404    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-kubernetes\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.905595 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905443    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73fdc034-84f9-4553-80ec-b2499bb6ff05-host-slash\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:26.905595 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzlfh\" (UniqueName: \"kubernetes.io/projected/b9300d83-29e9-46dd-9817-a33dae58c8e8-kube-api-access-gzlfh\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:26.905595 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905504    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.905595 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905528    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-sys-fs\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:26.905595 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905555    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-system-cni-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.905595 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-tmp\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z87k\" (UniqueName: \"kubernetes.io/projected/73fdc034-84f9-4553-80ec-b2499bb6ff05-kube-api-access-6z87k\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02df3d99-6357-4957-a7d5-3734ffd68714-agent-certs\") pod \"konnectivity-agent-fjn2t\" (UID: \"02df3d99-6357-4957-a7d5-3734ffd68714\") " pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-kubelet\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-socket-dir-parent\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905772    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-system-cni-dir\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6df1c290-c341-40cc-9644-82a9a471aa55-serviceca\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysconfig\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-lib-modules\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905872    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73fdc034-84f9-4553-80ec-b2499bb6ff05-iptables-alerter-script\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905897    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-systemd\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.905945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-cnibin\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.905998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-cni-binary-copy\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-etc-kubernetes\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-systemd-units\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906114    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-etc-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906135    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-systemd-units\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906146    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-systemd\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906181    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-log-socket\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906230    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-etc-kubernetes\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-env-overrides\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9688db4-1f96-436c-8543-1d8b36b15713-ovn-node-metrics-cert\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906275    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-etc-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-hostroot\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906328    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwp4\" (UniqueName: \"kubernetes.io/projected/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-kube-api-access-hfwp4\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:26.906543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-system-cni-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906420    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysctl-conf\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-run\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906454    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-host\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-var-lib-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-ovnkube-config\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-cni-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pbnh\" (UniqueName: \"kubernetes.io/projected/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-kube-api-access-6pbnh\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8xh5\" (UniqueName: \"kubernetes.io/projected/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-kube-api-access-n8xh5\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6df1c290-c341-40cc-9644-82a9a471aa55-host\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9300d83-29e9-46dd-9817-a33dae58c8e8-hosts-file\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906851    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-device-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-ovnkube-script-lib\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:26.906886    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-kubelet\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906950    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-cnibin\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.907423 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:26.906970    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs podName:ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:27.40694775 +0000 UTC m=+2.984542623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs") pod "network-metrics-daemon-jzkgz" (UID: "ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906981    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-env-overrides\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906991    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-kubelet\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-daemon-config\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-multus-certs\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906885    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-cni-binary-copy\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907071    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907124    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6df1c290-c341-40cc-9644-82a9a471aa55-host\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907163    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-var-lib-openvswitch\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907353    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6df1c290-c341-40cc-9644-82a9a471aa55-serviceca\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-cni-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907391    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-kubelet\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-sys\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907539    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-socket-dir-parent\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9300d83-29e9-46dd-9817-a33dae58c8e8-tmp-dir\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-daemon-config\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-run-netns\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.908298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907579    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-multus-certs\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.906452    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-system-cni-dir\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907672    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-run-netns\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-hostroot\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907853    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cnibin\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysctl-d\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907929    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-systemd\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-tuned\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.907990    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02df3d99-6357-4957-a7d5-3734ffd68714-konnectivity-ca\") pod \"konnectivity-agent-fjn2t\" (UID: \"02df3d99-6357-4957-a7d5-3734ffd68714\") " pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-cni-multus\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-ovnkube-config\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908105    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95skk\" (UniqueName: \"kubernetes.io/projected/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-kube-api-access-95skk\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908148    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-socket-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908217    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-log-socket\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-cni-bin\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.909247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908259    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp5ck\" (UniqueName: \"kubernetes.io/projected/a9688db4-1f96-436c-8543-1d8b36b15713-kube-api-access-pp5ck\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908316    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-cni-multus\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908358    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cnibin\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908411    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a9688db4-1f96-436c-8543-1d8b36b15713-ovnkube-script-lib\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-cni-bin\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-registration-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x49gw\" (UniqueName: \"kubernetes.io/projected/996cbeab-751d-4097-86e3-503a85950e3e-kube-api-access-x49gw\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908602    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-node-log\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908664    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02df3d99-6357-4957-a7d5-3734ffd68714-konnectivity-ca\") pod \"konnectivity-agent-fjn2t\" (UID: \"02df3d99-6357-4957-a7d5-3734ffd68714\") " pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-node-log\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-run-ovn-kubernetes\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-os-release\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908830    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-os-release\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-modprobe-d\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908871    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-run-ovn-kubernetes\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-cni-netd\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.910170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-var-lib-kubelet\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908977    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-slash\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.908997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-cni-netd\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-os-release\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-netns\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-host-slash\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-cni-bin\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-os-release\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909140    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-netns\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-conf-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909159    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-var-lib-cni-bin\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909201    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-multus-conf-dir\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909233    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b791044-ec01-4361-a7af-94b280ecf848-kubelet-config\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909394    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-ovn\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909424    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-k8s-cni-cncf-io\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.911054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909453    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gjkk\" (UniqueName: \"kubernetes.io/projected/6df1c290-c341-40cc-9644-82a9a471aa55-kube-api-access-6gjkk\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909461    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b791044-ec01-4361-a7af-94b280ecf848-kubelet-config\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b791044-ec01-4361-a7af-94b280ecf848-dbus\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909524    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:26.909660    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909734    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-host-run-k8s-cni-cncf-io\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909831    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a9688db4-1f96-436c-8543-1d8b36b15713-run-ovn\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909890    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b791044-ec01-4361-a7af-94b280ecf848-dbus\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:26.909919    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret podName:4b791044-ec01-4361-a7af-94b280ecf848 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:27.409898049 +0000 UTC m=+2.987492911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret") pod "global-pull-secret-syncer-rzmd7" (UID: "4b791044-ec01-4361-a7af-94b280ecf848") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.909924    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.911429    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02df3d99-6357-4957-a7d5-3734ffd68714-agent-certs\") pod \"konnectivity-agent-fjn2t\" (UID: \"02df3d99-6357-4957-a7d5-3734ffd68714\") " pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:26.912066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.912055    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a9688db4-1f96-436c-8543-1d8b36b15713-ovn-node-metrics-cert\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.917583 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.917501    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pbnh\" (UniqueName: \"kubernetes.io/projected/dbdecd91-1a3f-4f4a-836b-72bbd64dcb62-kube-api-access-6pbnh\") pod \"multus-rdwl9\" (UID: \"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62\") " pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:26.919030 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.919002    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwp4\" (UniqueName: \"kubernetes.io/projected/48a906e9-1a35-4b42-ac4d-0ef51c3f3551-kube-api-access-hfwp4\") pod \"multus-additional-cni-plugins-7cljj\" (UID: \"48a906e9-1a35-4b42-ac4d-0ef51c3f3551\") " pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:26.919293 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.919244    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp5ck\" (UniqueName: \"kubernetes.io/projected/a9688db4-1f96-436c-8543-1d8b36b15713-kube-api-access-pp5ck\") pod \"ovnkube-node-gglbf\" (UID: \"a9688db4-1f96-436c-8543-1d8b36b15713\") " pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:26.919841 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.919789    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8xh5\" (UniqueName: \"kubernetes.io/projected/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-kube-api-access-n8xh5\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:26.924765 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:26.924736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gjkk\" (UniqueName: \"kubernetes.io/projected/6df1c290-c341-40cc-9644-82a9a471aa55-kube-api-access-6gjkk\") pod \"node-ca-86vmd\" (UID: \"6df1c290-c341-40cc-9644-82a9a471aa55\") " pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.010569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysctl-conf\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.010641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-run\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.010688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-host\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.010722    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9300d83-29e9-46dd-9817-a33dae58c8e8-hosts-file\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.010798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysctl-conf\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.010926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-device-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.010974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-sys\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9300d83-29e9-46dd-9817-a33dae58c8e8-tmp-dir\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysctl-d\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-systemd\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011121    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-tuned\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95skk\" (UniqueName: \"kubernetes.io/projected/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-kube-api-access-95skk\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011311    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011343    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-socket-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-registration-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.013087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x49gw\" (UniqueName: \"kubernetes.io/projected/996cbeab-751d-4097-86e3-503a85950e3e-kube-api-access-x49gw\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011483    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-modprobe-d\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011514    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-var-lib-kubelet\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-kubernetes\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73fdc034-84f9-4553-80ec-b2499bb6ff05-host-slash\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011637    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzlfh\" (UniqueName: \"kubernetes.io/projected/b9300d83-29e9-46dd-9817-a33dae58c8e8-kube-api-access-gzlfh\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011684    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-sys-fs\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-tmp\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011771    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z87k\" (UniqueName: \"kubernetes.io/projected/73fdc034-84f9-4553-80ec-b2499bb6ff05-kube-api-access-6z87k\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011822    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011860    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysconfig\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-lib-modules\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.011992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73fdc034-84f9-4553-80ec-b2499bb6ff05-iptables-alerter-script\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.012770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73fdc034-84f9-4553-80ec-b2499bb6ff05-iptables-alerter-script\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.012867    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9300d83-29e9-46dd-9817-a33dae58c8e8-hosts-file\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.012953    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-run\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013158    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-modprobe-d\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014096 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013196    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysconfig\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013298    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-lib-modules\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013359    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-device-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013494    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-host\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013589    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-socket-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013606    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-sys-fs\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013595    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-sys\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013763    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-sysctl-d\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013778    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-var-lib-kubelet\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013883    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-systemd\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-kubernetes\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.013971    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73fdc034-84f9-4553-80ec-b2499bb6ff05-host-slash\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.014402    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-registration-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.014592    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/996cbeab-751d-4097-86e3-503a85950e3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.014914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.014897    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9300d83-29e9-46dd-9817-a33dae58c8e8-tmp-dir\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:27.016978 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.016954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-etc-tuned\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.017130 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.017031    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-tmp\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.022052 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.021985    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:22:27.022052 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.022014    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:22:27.022052 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.022031    2573 projected.go:196] Error preparing data for projected volume kube-api-access-8d2mj for pod openshift-network-diagnostics/network-check-target-7lpnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:27.022295 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.022111    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj podName:f7e44ae8-d853-432d-bef5-b4c774613c7d nodeName:}" failed. No retries permitted until 2026-07-28 17:22:27.522089124 +0000 UTC m=+3.099684005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2mj" (UniqueName: "kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj") pod "network-check-target-7lpnq" (UID: "f7e44ae8-d853-432d-bef5-b4c774613c7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:27.024784 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.024755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzlfh\" (UniqueName: \"kubernetes.io/projected/b9300d83-29e9-46dd-9817-a33dae58c8e8-kube-api-access-gzlfh\") pod \"node-resolver-phdpq\" (UID: \"b9300d83-29e9-46dd-9817-a33dae58c8e8\") " pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:27.024983 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.024954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z87k\" (UniqueName: \"kubernetes.io/projected/73fdc034-84f9-4553-80ec-b2499bb6ff05-kube-api-access-6z87k\") pod \"iptables-alerter-btq7g\" (UID: \"73fdc034-84f9-4553-80ec-b2499bb6ff05\") " pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:27.026610 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.026583    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95skk\" (UniqueName: \"kubernetes.io/projected/6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e-kube-api-access-95skk\") pod \"tuned-rhtqf\" (UID: \"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.027263 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.027237    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x49gw\" (UniqueName: \"kubernetes.io/projected/996cbeab-751d-4097-86e3-503a85950e3e-kube-api-access-x49gw\") pod \"aws-ebs-csi-driver-node-wgpzf\" (UID: \"996cbeab-751d-4097-86e3-503a85950e3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.099497 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.099449    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:27.111561 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.111536    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-86vmd"
Jul 28 17:22:27.122387 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.122365    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:27.129343 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.129317    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rdwl9"
Jul 28 17:22:27.139124 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.139101    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7cljj"
Jul 28 17:22:27.147934 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.147912    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-phdpq"
Jul 28 17:22:27.156838 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.156808    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rhtqf"
Jul 28 17:22:27.166810 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.166777    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btq7g"
Jul 28 17:22:27.172829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.172805    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf"
Jul 28 17:22:27.415202 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.415094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:27.415202 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.415169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:27.415444 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.415296    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:27.415444 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.415314    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:27.415444 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.415386    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret podName:4b791044-ec01-4361-a7af-94b280ecf848 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:28.415366342 +0000 UTC m=+3.992961207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret") pod "global-pull-secret-syncer-rzmd7" (UID: "4b791044-ec01-4361-a7af-94b280ecf848") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:27.415444 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.415412    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs podName:ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:28.415399264 +0000 UTC m=+3.992994145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs") pod "network-metrics-daemon-jzkgz" (UID: "ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:27.616635 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.616589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:27.616820 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.616764    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:22:27.616820 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.616789    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:22:27.616820 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.616802    2573 projected.go:196] Error preparing data for projected volume kube-api-access-8d2mj for pod openshift-network-diagnostics/network-check-target-7lpnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:27.616953 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.616860    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj podName:f7e44ae8-d853-432d-bef5-b4c774613c7d nodeName:}" failed. No retries permitted until 2026-07-28 17:22:28.616845857 +0000 UTC m=+4.194440715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2mj" (UniqueName: "kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj") pod "network-check-target-7lpnq" (UID: "f7e44ae8-d853-432d-bef5-b4c774613c7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:27.845676 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.845554    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:17:27 +0000 UTC" deadline="2028-04-17 09:25:06.030903488 +0000 UTC"
Jul 28 17:22:27.845676 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.845605    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15088h2m38.18530377s"
Jul 28 17:22:27.895016 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:27.894979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:27.895197 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:27.895104    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:27.919511 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:27.919374    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdecd91_1a3f_4f4a_836b_72bbd64dcb62.slice/crio-9b98e879472cb4c5f8d0ffb7c05c9f125930428696086cba038a2be8409d0e9e WatchSource:0}: Error finding container 9b98e879472cb4c5f8d0ffb7c05c9f125930428696086cba038a2be8409d0e9e: Status 404 returned error can't find the container with id 9b98e879472cb4c5f8d0ffb7c05c9f125930428696086cba038a2be8409d0e9e
Jul 28 17:22:27.934677 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:27.934647    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df1c290_c341_40cc_9644_82a9a471aa55.slice/crio-734e2073e8644008cf5c96877c013cd9b57bb1f85459552ad5531ab677a6fa11 WatchSource:0}: Error finding container 734e2073e8644008cf5c96877c013cd9b57bb1f85459552ad5531ab677a6fa11: Status 404 returned error can't find the container with id 734e2073e8644008cf5c96877c013cd9b57bb1f85459552ad5531ab677a6fa11
Jul 28 17:22:27.936289 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:27.936263    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02df3d99_6357_4957_a7d5_3734ffd68714.slice/crio-c763e7f9aaacdc19e6ee9ed9e41084df70a11e84f21ba9dbddee34998dc1e7e3 WatchSource:0}: Error finding container c763e7f9aaacdc19e6ee9ed9e41084df70a11e84f21ba9dbddee34998dc1e7e3: Status 404 returned error can't find the container with id c763e7f9aaacdc19e6ee9ed9e41084df70a11e84f21ba9dbddee34998dc1e7e3
Jul 28 17:22:27.937798 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:27.937718    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9688db4_1f96_436c_8543_1d8b36b15713.slice/crio-6821b393499d3f617ae542638bd7090f83946e481399bcfdc472e47f0cbc25ea WatchSource:0}: Error finding container 6821b393499d3f617ae542638bd7090f83946e481399bcfdc472e47f0cbc25ea: Status 404 returned error can't find the container with id 6821b393499d3f617ae542638bd7090f83946e481399bcfdc472e47f0cbc25ea
Jul 28 17:22:27.938521 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:27.938492    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1ca74f_0ce0_4c24_b73b_a1e8813ff87e.slice/crio-76c74185f7767fa2f2dd2d6af6299faae27661e705f07adbdcddf2a8077bb23b WatchSource:0}: Error finding container 76c74185f7767fa2f2dd2d6af6299faae27661e705f07adbdcddf2a8077bb23b: Status 404 returned error can't find the container with id 76c74185f7767fa2f2dd2d6af6299faae27661e705f07adbdcddf2a8077bb23b
Jul 28 17:22:27.943973 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:22:27.943597    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996cbeab_751d_4097_86e3_503a85950e3e.slice/crio-a506f180c949da17b29e9b8ae82828ddddb1ad52c267ccca5e2fd66e77771c86 WatchSource:0}: Error finding container a506f180c949da17b29e9b8ae82828ddddb1ad52c267ccca5e2fd66e77771c86: Status 404 returned error can't find the container with id a506f180c949da17b29e9b8ae82828ddddb1ad52c267ccca5e2fd66e77771c86
Jul 28 17:22:28.424305 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.423006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:28.424305 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.423359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:28.424305 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.423544    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:28.424305 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.423612    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs podName:ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:30.423591855 +0000 UTC m=+6.001186716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs") pod "network-metrics-daemon-jzkgz" (UID: "ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:28.424305 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.424121    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:28.424305 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.424178    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret podName:4b791044-ec01-4361-a7af-94b280ecf848 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:30.424161776 +0000 UTC m=+6.001756640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret") pod "global-pull-secret-syncer-rzmd7" (UID: "4b791044-ec01-4361-a7af-94b280ecf848") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:28.626151 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.625369    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:28.626151 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.625635    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:22:28.626151 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.625678    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:22:28.626151 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.625696    2573 projected.go:196] Error preparing data for projected volume kube-api-access-8d2mj for pod openshift-network-diagnostics/network-check-target-7lpnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:28.626151 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.625762    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj podName:f7e44ae8-d853-432d-bef5-b4c774613c7d nodeName:}" failed. No retries permitted until 2026-07-28 17:22:30.625743528 +0000 UTC m=+6.203338388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2mj" (UniqueName: "kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj") pod "network-check-target-7lpnq" (UID: "f7e44ae8-d853-432d-bef5-b4c774613c7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:28.846576 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.846454    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 17:17:27 +0000 UTC" deadline="2028-04-10 01:28:49.825772074 +0000 UTC"
Jul 28 17:22:28.846576 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.846522    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14912h6m20.979254788s"
Jul 28 17:22:28.896473 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.895826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:28.896473 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.895977    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:28.896473 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.896333    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:28.896473 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:28.896431    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:28.927579 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.926901    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" event={"ID":"146ec1ace48114f74bcbf562afadcc12","Type":"ContainerStarted","Data":"069918347cac15470395484b41bff3b667159476a04330832cc6857a72107594"}
Jul 28 17:22:28.944357 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.944306    2573 generic.go:356] "Generic (PLEG): container finished" podID="c25493469be6db5c640ec763bc3a85a7" containerID="a18a0abfc53ff27f20b444d331498e20a75aa10673029b1952509d8b357ed3fd" exitCode=0
Jul 28 17:22:28.944531 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.944434    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" event={"ID":"c25493469be6db5c640ec763bc3a85a7","Type":"ContainerDied","Data":"a18a0abfc53ff27f20b444d331498e20a75aa10673029b1952509d8b357ed3fd"}
Jul 28 17:22:28.945938 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.945882    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-249.ec2.internal" podStartSLOduration=2.94586138 podStartE2EDuration="2.94586138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:28.945169736 +0000 UTC m=+4.522764620" watchObservedRunningTime="2026-07-28 17:22:28.94586138 +0000 UTC m=+4.523456265"
Jul 28 17:22:28.971285 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.971247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btq7g" event={"ID":"73fdc034-84f9-4553-80ec-b2499bb6ff05","Type":"ContainerStarted","Data":"47d69b5fb4fa7a2b6bfb9fc74a75a13707aa1b4cecb889ba0dcc970d20bf25b3"}
Jul 28 17:22:28.976236 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.976187    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-phdpq" event={"ID":"b9300d83-29e9-46dd-9817-a33dae58c8e8","Type":"ContainerStarted","Data":"459408ee76e3d6304c4f02978d720cd73e6daf1d5a9a1ede3aed1e7e038d8abb"}
Jul 28 17:22:28.986093 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.986046    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf" event={"ID":"996cbeab-751d-4097-86e3-503a85950e3e","Type":"ContainerStarted","Data":"a506f180c949da17b29e9b8ae82828ddddb1ad52c267ccca5e2fd66e77771c86"}
Jul 28 17:22:28.999338 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:28.999296    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"6821b393499d3f617ae542638bd7090f83946e481399bcfdc472e47f0cbc25ea"}
Jul 28 17:22:29.007379 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:29.007295    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-86vmd" event={"ID":"6df1c290-c341-40cc-9644-82a9a471aa55","Type":"ContainerStarted","Data":"734e2073e8644008cf5c96877c013cd9b57bb1f85459552ad5531ab677a6fa11"}
Jul 28 17:22:29.009460 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:29.009356    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rdwl9" event={"ID":"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62","Type":"ContainerStarted","Data":"9b98e879472cb4c5f8d0ffb7c05c9f125930428696086cba038a2be8409d0e9e"}
Jul 28 17:22:29.015293 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:29.015222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cljj" event={"ID":"48a906e9-1a35-4b42-ac4d-0ef51c3f3551","Type":"ContainerStarted","Data":"6e9b3d065b876f8408e79f29c835fe67c33de6f31aa30deb9492fe3ae4484517"}
Jul 28 17:22:29.021033 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:29.020992    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rhtqf" event={"ID":"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e","Type":"ContainerStarted","Data":"76c74185f7767fa2f2dd2d6af6299faae27661e705f07adbdcddf2a8077bb23b"}
Jul 28 17:22:29.037217 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:29.037171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjn2t" event={"ID":"02df3d99-6357-4957-a7d5-3734ffd68714","Type":"ContainerStarted","Data":"c763e7f9aaacdc19e6ee9ed9e41084df70a11e84f21ba9dbddee34998dc1e7e3"}
Jul 28 17:22:29.895422 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:29.895335    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:29.895945 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:29.895476    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:30.067853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:30.067760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" event={"ID":"c25493469be6db5c640ec763bc3a85a7","Type":"ContainerStarted","Data":"3c81f30502a53ef3d8b921dc588054cbebaf8a484ac7f4fe3ece2d9f3ce8733b"}
Jul 28 17:22:30.445552 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:30.445509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:30.445774 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:30.445610    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:30.445869 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.445814    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:30.445926 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.445916    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs podName:ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:34.445867317 +0000 UTC m=+10.023462181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs") pod "network-metrics-daemon-jzkgz" (UID: "ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:30.446409 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.446389    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:30.446488 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.446460    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret podName:4b791044-ec01-4361-a7af-94b280ecf848 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:34.446441807 +0000 UTC m=+10.024036666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret") pod "global-pull-secret-syncer-rzmd7" (UID: "4b791044-ec01-4361-a7af-94b280ecf848") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:30.647220 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:30.647181    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:30.647417 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.647391    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:22:30.647482 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.647423    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:22:30.647482 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.647438    2573 projected.go:196] Error preparing data for projected volume kube-api-access-8d2mj for pod openshift-network-diagnostics/network-check-target-7lpnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:30.647584 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.647503    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj podName:f7e44ae8-d853-432d-bef5-b4c774613c7d nodeName:}" failed. No retries permitted until 2026-07-28 17:22:34.64748301 +0000 UTC m=+10.225077892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2mj" (UniqueName: "kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj") pod "network-check-target-7lpnq" (UID: "f7e44ae8-d853-432d-bef5-b4c774613c7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:30.896844 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:30.896752    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:30.897326 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.896924    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:30.897326 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:30.897093    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:30.897326 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:30.897179    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:31.895465 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:31.895423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:31.895656 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:31.895569    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:32.896296 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:32.895727    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:32.896296 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:32.895765    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:32.896296 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:32.895896    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:32.896296 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:32.896062    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:33.895304 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:33.895133    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:33.895304 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:33.895258    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:34.482912 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:34.482875    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:34.483437 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.483041    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:34.483437 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.483111    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs podName:ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:42.483095666 +0000 UTC m=+18.060690527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs") pod "network-metrics-daemon-jzkgz" (UID: "ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:34.483437 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:34.483390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:34.483657 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.483482    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:34.483657 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.483513    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret podName:4b791044-ec01-4361-a7af-94b280ecf848 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:42.48350341 +0000 UTC m=+18.061098266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret") pod "global-pull-secret-syncer-rzmd7" (UID: "4b791044-ec01-4361-a7af-94b280ecf848") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:34.686184 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:34.685546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:34.686184 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.685742    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:22:34.686184 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.685764    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:22:34.686184 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.685777    2573 projected.go:196] Error preparing data for projected volume kube-api-access-8d2mj for pod openshift-network-diagnostics/network-check-target-7lpnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:34.686184 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.685847    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj podName:f7e44ae8-d853-432d-bef5-b4c774613c7d nodeName:}" failed. No retries permitted until 2026-07-28 17:22:42.685828422 +0000 UTC m=+18.263423291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2mj" (UniqueName: "kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj") pod "network-check-target-7lpnq" (UID: "f7e44ae8-d853-432d-bef5-b4c774613c7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:34.896355 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:34.895667    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:34.896355 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.895787    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:34.896355 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:34.896147    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:34.896355 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:34.896245    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:35.894848 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:35.894589    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:35.894848 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:35.894757    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:36.895841 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:36.895761    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:36.896304 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:36.895917    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:36.896480 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:36.896461    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:36.896621 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:36.896583    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:37.895315 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:37.895278    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:37.895520 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:37.895425    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:38.895451 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:38.895415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:38.895885 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:38.895415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:38.895885 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:38.895573    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:38.895885 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:38.895648    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:39.895485 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:39.895446    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:39.895970 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:39.895585    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:40.894761 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:40.894699    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:40.894954 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:40.894714    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:40.894954 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:40.894862    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:40.894954 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:40.894923    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:41.894813 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:41.894771    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:41.895281 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:41.894932    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:42.545128 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:42.545091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:42.545327 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:42.545143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:42.545327 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.545257    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:42.545327 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.545250    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:42.545455 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.545348    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret podName:4b791044-ec01-4361-a7af-94b280ecf848 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:58.545324411 +0000 UTC m=+34.122919271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret") pod "global-pull-secret-syncer-rzmd7" (UID: "4b791044-ec01-4361-a7af-94b280ecf848") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:42.545455 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.545372    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs podName:ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1 nodeName:}" failed. No retries permitted until 2026-07-28 17:22:58.545361927 +0000 UTC m=+34.122956783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs") pod "network-metrics-daemon-jzkgz" (UID: "ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:42.746472 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:42.746431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:42.746672 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.746649    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:22:42.746724 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.746680    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:22:42.746724 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.746695    2573 projected.go:196] Error preparing data for projected volume kube-api-access-8d2mj for pod openshift-network-diagnostics/network-check-target-7lpnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:42.746784 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.746762    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj podName:f7e44ae8-d853-432d-bef5-b4c774613c7d nodeName:}" failed. No retries permitted until 2026-07-28 17:22:58.74674184 +0000 UTC m=+34.324336703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2mj" (UniqueName: "kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj") pod "network-check-target-7lpnq" (UID: "f7e44ae8-d853-432d-bef5-b4c774613c7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:42.896066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:42.895958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:42.896519 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.896129    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:42.896519 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:42.896148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:42.896519 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:42.896351    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:43.894593 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:43.894556    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:43.894780 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:43.894705    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:44.895719 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:44.895677    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:44.896263 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:44.895808    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:44.896263 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:44.895859    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:44.896263 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:44.895976    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:45.894813 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:45.894772    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:45.895003 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:45.894908    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:46.894724 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:46.894687    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:46.895108 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:46.894687    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:46.895108 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:46.894797    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:46.895108 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:46.894883    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:47.107595 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.107286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-phdpq" event={"ID":"b9300d83-29e9-46dd-9817-a33dae58c8e8","Type":"ContainerStarted","Data":"76cfeae6d22b0c6539ba352bb567b9cf9abad9a404bd546b0076bd15a6f14cb9"}
Jul 28 17:22:47.110464 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.110430    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rdwl9" event={"ID":"dbdecd91-1a3f-4f4a-836b-72bbd64dcb62","Type":"ContainerStarted","Data":"0885588b44c1ac61d31e3e89802cec84b8eebd95240281d47b85bc6c6c1319e7"}
Jul 28 17:22:47.112907 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.112880    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rhtqf" event={"ID":"6f1ca74f-0ce0-4c24-b73b-a1e8813ff87e","Type":"ContainerStarted","Data":"effa0f1ab29994f16d87d2a0cc2bd5145338578371c43580b97110e263260b32"}
Jul 28 17:22:47.116977 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.116766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjn2t" event={"ID":"02df3d99-6357-4957-a7d5-3734ffd68714","Type":"ContainerStarted","Data":"3bef6a41064f4778fec3081b5c1b3f74a68f0b48181bfad2dafd50d7369d1f3b"}
Jul 28 17:22:47.125462 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.125397    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-phdpq" podStartSLOduration=2.124014152 podStartE2EDuration="21.125375161s" totalImagesPullingTime="19.001361009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:47.125079617 +0000 UTC m=+22.702674496" watchObservedRunningTime="2026-07-28 17:22:47.125375161 +0000 UTC m=+22.702970040"
Jul 28 17:22:47.125601 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.125566    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-249.ec2.internal" podStartSLOduration=21.125557849 podStartE2EDuration="21.125557849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:30.08681693 +0000 UTC m=+5.664411814" watchObservedRunningTime="2026-07-28 17:22:47.125557849 +0000 UTC m=+22.703152728"
Jul 28 17:22:47.164762 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.164698    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fjn2t" podStartSLOduration=11.094693605 podStartE2EDuration="22.164653172s" totalImagesPullingTime="11.069959567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:47.143538396 +0000 UTC m=+22.721133275" watchObservedRunningTime="2026-07-28 17:22:47.164653172 +0000 UTC m=+22.742248051"
Jul 28 17:22:47.185899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.185836    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rhtqf" podStartSLOduration=2.177495456 podStartE2EDuration="21.185815513s" totalImagesPullingTime="19.008320057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:47.164292315 +0000 UTC m=+22.741887198" watchObservedRunningTime="2026-07-28 17:22:47.185815513 +0000 UTC m=+22.763410390"
Jul 28 17:22:47.438493 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.438468    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:47.439091 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.439067    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:47.474287 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.474239    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rdwl9" podStartSLOduration=3.406378926 podStartE2EDuration="22.474221577s" totalImagesPullingTime="19.067842651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:47.186811854 +0000 UTC m=+22.764406732" watchObservedRunningTime="2026-07-28 17:22:47.474221577 +0000 UTC m=+23.051816455"
Jul 28 17:22:47.895486 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:47.895407    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:47.896231 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:47.895552    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:48.120662 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.120622    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf" event={"ID":"996cbeab-751d-4097-86e3-503a85950e3e","Type":"ContainerStarted","Data":"65bead8ffbe873d5c7e987554e1229a707e55e8fd92d4ddfd76a100834c1b426"}
Jul 28 17:22:48.123588 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.123559    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"76ec858241c25ef56438848e7b98992265303e8721595521578674b1410726c9"}
Jul 28 17:22:48.123759 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.123651    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"9789f380d9c1ec4f3dfdc30756d858afb6619895a93569dec77e251ff0ec0bbc"}
Jul 28 17:22:48.123759 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.123691    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"74dfce1f2e840c2c4fe04488360038ebad81d3cdd08a4b2b58b20632b78649a8"}
Jul 28 17:22:48.123759 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.123723    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"ba9fe3b81e2bf6fb74023d0c3c7ba3781036ed8ac72fd0175ed8e378d5185877"}
Jul 28 17:22:48.123759 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.123756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"dda68c4fdd3c660293a39997dc1b1d6daf7db4df87af4051d61078c3726e1457"}
Jul 28 17:22:48.123905 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.123787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"127d14877f006416a2adead6e6c710e017e194f3194d4a486884b9a46798530c"}
Jul 28 17:22:48.124941 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.124917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-86vmd" event={"ID":"6df1c290-c341-40cc-9644-82a9a471aa55","Type":"ContainerStarted","Data":"ab0f6ca5dfd7c141632f3edeb726d813a6385b668606f2730e30a599f004c9d8"}
Jul 28 17:22:48.126347 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.126322    2573 generic.go:356] "Generic (PLEG): container finished" podID="48a906e9-1a35-4b42-ac4d-0ef51c3f3551" containerID="9186b008be33ddd0c44634777e7660dc7d97b15a9dfd109ccf6a7b45e8989f49" exitCode=0
Jul 28 17:22:48.126458 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.126423    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cljj" event={"ID":"48a906e9-1a35-4b42-ac4d-0ef51c3f3551","Type":"ContainerDied","Data":"9186b008be33ddd0c44634777e7660dc7d97b15a9dfd109ccf6a7b45e8989f49"}
Jul 28 17:22:48.142464 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.142415    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-86vmd" podStartSLOduration=4.13153872 podStartE2EDuration="23.142398346s" totalImagesPullingTime="19.010859626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:48.142057291 +0000 UTC m=+23.719652169" watchObservedRunningTime="2026-07-28 17:22:48.142398346 +0000 UTC m=+23.719993224"
Jul 28 17:22:48.400524 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.400497    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 17:22:48.856217 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.856055    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T17:22:48.400516988Z","UUID":"e3d0071f-2dd4-4dc9-bc67-ed4f494f419a","Handler":null,"Name":"","Endpoint":""}
Jul 28 17:22:48.857811 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.857782    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 17:22:48.857951 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.857826    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 17:22:48.894718 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.894683    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:48.894902 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:48.894831    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:48.895357 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:48.895325    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:48.895482 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:48.895440    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:49.130988 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:49.130897    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btq7g" event={"ID":"73fdc034-84f9-4553-80ec-b2499bb6ff05","Type":"ContainerStarted","Data":"83e12b6166bfc6c6c5efa23127a979231b178d1bbda9d9f3f577dfb0ec8266f1"}
Jul 28 17:22:49.133394 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:49.133368    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 17:22:49.133801 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:49.133765    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf" event={"ID":"996cbeab-751d-4097-86e3-503a85950e3e","Type":"ContainerStarted","Data":"215a6e7bf88dda71b7bba9e92964315d0f630269020883b6097df4147e36439a"}
Jul 28 17:22:49.147234 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:49.147169    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-btq7g" podStartSLOduration=4.14714461 podStartE2EDuration="23.14714454s" totalImagesPullingTime="18.99999993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:49.146797138 +0000 UTC m=+24.724392029" watchObservedRunningTime="2026-07-28 17:22:49.14714454 +0000 UTC m=+24.724739434"
Jul 28 17:22:49.895088 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:49.895058    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:49.895286 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:49.895197    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:50.137933 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:50.137837    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf" event={"ID":"996cbeab-751d-4097-86e3-503a85950e3e","Type":"ContainerStarted","Data":"360e52fd1f0ec0db80e1d487c968ab5e8a254f27153b4241a6212415f419294a"}
Jul 28 17:22:50.141672 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:50.141637    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"e722900ff8994f5bf224bf74df6e39fb0fc050f9f7c8e506832e9a0201824716"}
Jul 28 17:22:50.164909 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:50.164849    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wgpzf" podStartSLOduration=2.924300469 podStartE2EDuration="24.164831821s" totalImagesPullingTime="21.240531352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:50.164202246 +0000 UTC m=+25.741797126" watchObservedRunningTime="2026-07-28 17:22:50.164831821 +0000 UTC m=+25.742426696"
Jul 28 17:22:50.895258 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:50.895012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:50.895456 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:50.895013    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:50.895456 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:50.895429    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:50.895599 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:50.895567    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:51.894775 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:51.894744    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:51.895167 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:51.894870    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:52.895483 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:52.895221    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:52.895483 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:52.895228    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:52.896221 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:52.895491    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:52.896221 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:52.895564    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:53.150918 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.150829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" event={"ID":"a9688db4-1f96-436c-8543-1d8b36b15713","Type":"ContainerStarted","Data":"47c1dada545c2207919b5d3df841aa017ed58e0eb8cb8532ba94eb4728057bf1"}
Jul 28 17:22:53.151093 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.151061    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:53.152685 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.152660    2573 generic.go:356] "Generic (PLEG): container finished" podID="48a906e9-1a35-4b42-ac4d-0ef51c3f3551" containerID="f65b6daf57b9d4f111fcf995b63b41e3d8bca39baf1e24c896d3a6f3141b5793" exitCode=0
Jul 28 17:22:53.152801 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.152696    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cljj" event={"ID":"48a906e9-1a35-4b42-ac4d-0ef51c3f3551","Type":"ContainerDied","Data":"f65b6daf57b9d4f111fcf995b63b41e3d8bca39baf1e24c896d3a6f3141b5793"}
Jul 28 17:22:53.166907 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.166879    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:53.182105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.182040    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf" podStartSLOduration=9.096711773 podStartE2EDuration="28.182024783s" totalImagesPullingTime="19.08531301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:22:53.181497442 +0000 UTC m=+28.759092319" watchObservedRunningTime="2026-07-28 17:22:53.182024783 +0000 UTC m=+28.759619663"
Jul 28 17:22:53.895210 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.895121    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:53.895415 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:53.895252    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:53.996992 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.996954    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:53.997437 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.997119    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 17:22:53.997596 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:53.997579    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fjn2t"
Jul 28 17:22:54.157406 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.157361    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:54.157764 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.157744    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:54.173168 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.173146    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:22:54.280952 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.280920    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lpnq"]
Jul 28 17:22:54.281115 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.281034    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:54.281170 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:54.281119    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:54.285092 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.285055    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rzmd7"]
Jul 28 17:22:54.285233 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.285145    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:54.285233 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:54.285226    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:54.288058 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.288032    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jzkgz"]
Jul 28 17:22:54.288179 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:54.288169    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:54.288322 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:54.288300    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:55.161710 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:55.161676    2573 generic.go:356] "Generic (PLEG): container finished" podID="48a906e9-1a35-4b42-ac4d-0ef51c3f3551" containerID="7bdd0cabbf4581b371dc1d00d6a1a78bb4fb29234f0ef9e60cd88720da3822b1" exitCode=0
Jul 28 17:22:55.162187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:55.161763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cljj" event={"ID":"48a906e9-1a35-4b42-ac4d-0ef51c3f3551","Type":"ContainerDied","Data":"7bdd0cabbf4581b371dc1d00d6a1a78bb4fb29234f0ef9e60cd88720da3822b1"}
Jul 28 17:22:55.895479 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:55.895441    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:55.895680 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:55.895442    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:55.895680 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:55.895573    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:55.895680 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:55.895449    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:55.895875 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:55.895687    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:55.895875 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:55.895801    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:57.169204 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:57.168993    2573 generic.go:356] "Generic (PLEG): container finished" podID="48a906e9-1a35-4b42-ac4d-0ef51c3f3551" containerID="e9ea3afb6c7955189c374a95a7dd6536c696da0e5b58a3b138417b0d0206849f" exitCode=0
Jul 28 17:22:57.169204 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:57.169081    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cljj" event={"ID":"48a906e9-1a35-4b42-ac4d-0ef51c3f3551","Type":"ContainerDied","Data":"e9ea3afb6c7955189c374a95a7dd6536c696da0e5b58a3b138417b0d0206849f"}
Jul 28 17:22:57.894855 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:57.894814    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:57.895035 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:57.894864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:57.895035 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:57.894864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:57.895035 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:57.894961    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7lpnq" podUID="f7e44ae8-d853-432d-bef5-b4c774613c7d"
Jul 28 17:22:57.895190 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:57.895031    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rzmd7" podUID="4b791044-ec01-4361-a7af-94b280ecf848"
Jul 28 17:22:57.895190 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:57.895100    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jzkgz" podUID="ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1"
Jul 28 17:22:58.563564 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:58.563530    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:58.564076 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:58.563575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:58.564076 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:58.563682    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:58.564076 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:58.563730    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs podName:ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:30.56371728 +0000 UTC m=+66.141312137 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs") pod "network-metrics-daemon-jzkgz" (UID: "ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 17:22:58.564076 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:58.563683    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:58.564076 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:58.563806    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret podName:4b791044-ec01-4361-a7af-94b280ecf848 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:30.563792896 +0000 UTC m=+66.141387755 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret") pod "global-pull-secret-syncer-rzmd7" (UID: "4b791044-ec01-4361-a7af-94b280ecf848") : object "kube-system"/"original-pull-secret" not registered
Jul 28 17:22:58.765140 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:58.765104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:58.765332 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:58.765290    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 17:22:58.765332 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:58.765317    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 17:22:58.765332 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:58.765329    2573 projected.go:196] Error preparing data for projected volume kube-api-access-8d2mj for pod openshift-network-diagnostics/network-check-target-7lpnq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:58.765438 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:22:58.765388    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj podName:f7e44ae8-d853-432d-bef5-b4c774613c7d nodeName:}" failed. No retries permitted until 2026-07-28 17:23:30.765369162 +0000 UTC m=+66.342964037 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2mj" (UniqueName: "kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj") pod "network-check-target-7lpnq" (UID: "f7e44ae8-d853-432d-bef5-b4c774613c7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 17:22:59.782920 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.782836    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-249.ec2.internal" event="NodeReady"
Jul 28 17:22:59.783450 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.783012    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 17:22:59.824726 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.824690    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-644dbc6566-xcvbc"]
Jul 28 17:22:59.827625 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.827581    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.830112 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.830083    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 17:22:59.830112 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.830112    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 17:22:59.830420 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.830385    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 17:22:59.830545 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.830462    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7d6vn\""
Jul 28 17:22:59.836329 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.836310    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 17:22:59.840055 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.840031    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hfjmc"]
Jul 28 17:22:59.845444 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.845411    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-644dbc6566-xcvbc"]
Jul 28 17:22:59.845593 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.845541    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:22:59.847087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.846940    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-g7pmp"]
Jul 28 17:22:59.848544 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.848373    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 17:22:59.848544 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.848403    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fqthr\""
Jul 28 17:22:59.848985 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.848891    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 17:22:59.849532 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.849508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g7pmp"
Jul 28 17:22:59.852217 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.852192    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 17:22:59.853213 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.852212    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 17:22:59.853340 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.852224    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 17:22:59.853526 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.853507    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfjmc"]
Jul 28 17:22:59.853668 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.853624    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h4rhp\""
Jul 28 17:22:59.862774 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.862748    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g7pmp"]
Jul 28 17:22:59.894708 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.894671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:22:59.894900 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.894668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:22:59.895048 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.894668    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:22:59.898035 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.898007    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:22:59.898197 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.898059    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:22:59.898197 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.898159    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27qqv\""
Jul 28 17:22:59.898197 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.898173    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:22:59.898918 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.898720    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ztptx\""
Jul 28 17:22:59.898918 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.898777    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:22:59.975792 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.975749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-trusted-ca\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.975792 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.975787    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-installation-pull-secrets\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.976052 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.975813    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dceaf718-af8e-484c-b1ef-5b7fa813199d-tmp-dir\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:22:59.976052 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.975897    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-image-registry-private-configuration\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.976052 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.975932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-ca-trust-extracted\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.976052 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.975998    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-certificates\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.976052 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976027    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq6x5\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-kube-api-access-qq6x5\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.976307 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-bound-sa-token\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.976307 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dceaf718-af8e-484c-b1ef-5b7fa813199d-config-volume\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:22:59.976307 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976114    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvl7x\" (UniqueName: \"kubernetes.io/projected/dceaf718-af8e-484c-b1ef-5b7fa813199d-kube-api-access-mvl7x\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:22:59.976307 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/123ab06e-cb59-4cef-a66e-50dd483a4721-cert\") pod \"ingress-canary-g7pmp\" (UID: \"123ab06e-cb59-4cef-a66e-50dd483a4721\") " pod="openshift-ingress-canary/ingress-canary-g7pmp"
Jul 28 17:22:59.976307 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:22:59.976307 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976205    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:22:59.976307 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j676b\" (UniqueName: \"kubernetes.io/projected/123ab06e-cb59-4cef-a66e-50dd483a4721-kube-api-access-j676b\") pod \"ingress-canary-g7pmp\" (UID: \"123ab06e-cb59-4cef-a66e-50dd483a4721\") " pod="openshift-ingress-canary/ingress-canary-g7pmp"
Jul 28 17:22:59.976671 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:22:59.976457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:00.067692 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.067591    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:00.076660 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-trusted-ca\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.076829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-installation-pull-secrets\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.076829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dceaf718-af8e-484c-b1ef-5b7fa813199d-tmp-dir\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:00.076829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076734    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-image-registry-private-configuration\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.076829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076762    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-ca-trust-extracted\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.076829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-certificates\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.076829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq6x5\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-kube-api-access-qq6x5\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.077084 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-bound-sa-token\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.077084 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dceaf718-af8e-484c-b1ef-5b7fa813199d-config-volume\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:00.077084 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076887    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvl7x\" (UniqueName: \"kubernetes.io/projected/dceaf718-af8e-484c-b1ef-5b7fa813199d-kube-api-access-mvl7x\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:00.077084 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/123ab06e-cb59-4cef-a66e-50dd483a4721-cert\") pod \"ingress-canary-g7pmp\" (UID: \"123ab06e-cb59-4cef-a66e-50dd483a4721\") " pod="openshift-ingress-canary/ingress-canary-g7pmp"
Jul 28 17:23:00.077084 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.076940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.077084 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.077030    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:23:00.077084 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.077044    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dbc6566-xcvbc: secret "image-registry-tls" not found
Jul 28 17:23:00.077379 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.077116    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls podName:8b60ddbe-5677-4a56-9ac8-9c05573e5d33 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:00.577096512 +0000 UTC m=+36.154691390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls") pod "image-registry-644dbc6566-xcvbc" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33") : secret "image-registry-tls" not found
Jul 28 17:23:00.077518 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.077493    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-certificates\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.077589 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.077548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:00.077589 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.077581    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j676b\" (UniqueName: \"kubernetes.io/projected/123ab06e-cb59-4cef-a66e-50dd483a4721-kube-api-access-j676b\") pod \"ingress-canary-g7pmp\" (UID: \"123ab06e-cb59-4cef-a66e-50dd483a4721\") " pod="openshift-ingress-canary/ingress-canary-g7pmp"
Jul 28 17:23:00.077827 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.077703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-trusted-ca\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.077827 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.077761    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-ca-trust-extracted\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.077921 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.077838    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:23:00.077921 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.077884    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls podName:dceaf718-af8e-484c-b1ef-5b7fa813199d nodeName:}" failed. No retries permitted until 2026-07-28 17:23:00.577867875 +0000 UTC m=+36.155462736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls") pod "dns-default-hfjmc" (UID: "dceaf718-af8e-484c-b1ef-5b7fa813199d") : secret "dns-default-metrics-tls" not found
Jul 28 17:23:00.077921 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.077899    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dceaf718-af8e-484c-b1ef-5b7fa813199d-config-volume\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:00.078068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.077947    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dceaf718-af8e-484c-b1ef-5b7fa813199d-tmp-dir\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:00.081804 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.081766    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-installation-pull-secrets\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.081804 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.081779    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/123ab06e-cb59-4cef-a66e-50dd483a4721-cert\") pod \"ingress-canary-g7pmp\" (UID: \"123ab06e-cb59-4cef-a66e-50dd483a4721\") " pod="openshift-ingress-canary/ingress-canary-g7pmp"
Jul 28 17:23:00.081991 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.081860    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-image-registry-private-configuration\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.086433 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.086402    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-bound-sa-token\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.086858 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.086835    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j676b\" (UniqueName: \"kubernetes.io/projected/123ab06e-cb59-4cef-a66e-50dd483a4721-kube-api-access-j676b\") pod \"ingress-canary-g7pmp\" (UID: \"123ab06e-cb59-4cef-a66e-50dd483a4721\") " pod="openshift-ingress-canary/ingress-canary-g7pmp"
Jul 28 17:23:00.087266 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.087230    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq6x5\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-kube-api-access-qq6x5\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.088247 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.088189    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvl7x\" (UniqueName: \"kubernetes.io/projected/dceaf718-af8e-484c-b1ef-5b7fa813199d-kube-api-access-mvl7x\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:00.166124 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.166082    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-g7pmp"
Jul 28 17:23:00.351551 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.351457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:00.416077 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.416038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:00.483402 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.483361    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:00.581026 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.580990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:00.581210 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:00.581048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:00.581210 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.581172    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:23:00.581210 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.581195    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dbc6566-xcvbc: secret "image-registry-tls" not found
Jul 28 17:23:00.581210 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.581201    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:23:00.581457 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.581263    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls podName:dceaf718-af8e-484c-b1ef-5b7fa813199d nodeName:}" failed. No retries permitted until 2026-07-28 17:23:01.581242675 +0000 UTC m=+37.158837532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls") pod "dns-default-hfjmc" (UID: "dceaf718-af8e-484c-b1ef-5b7fa813199d") : secret "dns-default-metrics-tls" not found
Jul 28 17:23:00.581457 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:00.581281    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls podName:8b60ddbe-5677-4a56-9ac8-9c05573e5d33 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:01.58127436 +0000 UTC m=+37.158869215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls") pod "image-registry-644dbc6566-xcvbc" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33") : secret "image-registry-tls" not found
Jul 28 17:23:01.236167 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:01.236126    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:01.339338 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:01.339269    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:01.550417 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:01.550158    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-g7pmp"]
Jul 28 17:23:01.554463 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:01.554429    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:01.555354 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:23:01.555324    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123ab06e_cb59_4cef_a66e_50dd483a4721.slice/crio-aa7137f42ee1701cbdaba50fa7171ccf04434c7600454ea5944c461ee72125ed WatchSource:0}: Error finding container aa7137f42ee1701cbdaba50fa7171ccf04434c7600454ea5944c461ee72125ed: Status 404 returned error can't find the container with id aa7137f42ee1701cbdaba50fa7171ccf04434c7600454ea5944c461ee72125ed
Jul 28 17:23:01.589845 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:01.589810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:01.590009 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:01.589991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:01.590061 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:01.590010    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:23:01.590108 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:01.590094    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls podName:dceaf718-af8e-484c-b1ef-5b7fa813199d nodeName:}" failed. No retries permitted until 2026-07-28 17:23:03.590069182 +0000 UTC m=+39.167664061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls") pod "dns-default-hfjmc" (UID: "dceaf718-af8e-484c-b1ef-5b7fa813199d") : secret "dns-default-metrics-tls" not found
Jul 28 17:23:01.590147 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:01.590099    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:23:01.590147 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:01.590121    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dbc6566-xcvbc: secret "image-registry-tls" not found
Jul 28 17:23:01.590204 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:01.590156    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls podName:8b60ddbe-5677-4a56-9ac8-9c05573e5d33 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:03.59014421 +0000 UTC m=+39.167739115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls") pod "image-registry-644dbc6566-xcvbc" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33") : secret "image-registry-tls" not found
Jul 28 17:23:01.654527 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:01.654499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:02.185455 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:02.185406    2573 generic.go:356] "Generic (PLEG): container finished" podID="48a906e9-1a35-4b42-ac4d-0ef51c3f3551" containerID="6b177c5c015f05fce4436b60f0d2b11d0c976d2cf5d2b0a5c63a17b0d1ba9a17" exitCode=0
Jul 28 17:23:02.185647 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:02.185493    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cljj" event={"ID":"48a906e9-1a35-4b42-ac4d-0ef51c3f3551","Type":"ContainerDied","Data":"6b177c5c015f05fce4436b60f0d2b11d0c976d2cf5d2b0a5c63a17b0d1ba9a17"}
Jul 28 17:23:02.186824 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:02.186796    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g7pmp" event={"ID":"123ab06e-cb59-4cef-a66e-50dd483a4721","Type":"ContainerStarted","Data":"aa7137f42ee1701cbdaba50fa7171ccf04434c7600454ea5944c461ee72125ed"}
Jul 28 17:23:03.196583 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:03.196545    2573 generic.go:356] "Generic (PLEG): container finished" podID="48a906e9-1a35-4b42-ac4d-0ef51c3f3551" containerID="29255c4bf7ade75d77d17e15235d14a0fba1804a052af84dccdac3737113f9dd" exitCode=0
Jul 28 17:23:03.197122 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:03.196599    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cljj" event={"ID":"48a906e9-1a35-4b42-ac4d-0ef51c3f3551","Type":"ContainerDied","Data":"29255c4bf7ade75d77d17e15235d14a0fba1804a052af84dccdac3737113f9dd"}
Jul 28 17:23:03.607447 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:03.607356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:03.607601 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:03.607501    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:03.607601 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:03.607532    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:23:03.607756 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:03.607630    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls podName:dceaf718-af8e-484c-b1ef-5b7fa813199d nodeName:}" failed. No retries permitted until 2026-07-28 17:23:07.607591719 +0000 UTC m=+43.185186599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls") pod "dns-default-hfjmc" (UID: "dceaf718-af8e-484c-b1ef-5b7fa813199d") : secret "dns-default-metrics-tls" not found
Jul 28 17:23:03.607756 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:03.607635    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:23:03.607756 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:03.607656    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dbc6566-xcvbc: secret "image-registry-tls" not found
Jul 28 17:23:03.607756 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:03.607706    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls podName:8b60ddbe-5677-4a56-9ac8-9c05573e5d33 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:07.607689385 +0000 UTC m=+43.185284248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls") pod "image-registry-644dbc6566-xcvbc" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33") : secret "image-registry-tls" not found
Jul 28 17:23:04.203235 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:04.203034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cljj" event={"ID":"48a906e9-1a35-4b42-ac4d-0ef51c3f3551","Type":"ContainerStarted","Data":"6e6e4b46ebeea4171a7a4ef1273bf9229893ae5d913f00d1f96a0a9539d442f7"}
Jul 28 17:23:04.204631 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:04.204590    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-g7pmp" event={"ID":"123ab06e-cb59-4cef-a66e-50dd483a4721","Type":"ContainerStarted","Data":"15f72fbd2e04afc137727831d7a33c47bbe262013c5b6c5e31351cff909b82b5"}
Jul 28 17:23:04.248591 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:04.248532    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7cljj" podStartSLOduration=9.019727146 podStartE2EDuration="38.248516244s" totalImagesPullingTime="29.228789098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:04.248327414 +0000 UTC m=+39.825922292" watchObservedRunningTime="2026-07-28 17:23:04.248516244 +0000 UTC m=+39.826111122"
Jul 28 17:23:04.406343 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:04.406256    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:04.476702 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:04.476663    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:04.543196 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:04.543167    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:04.969511 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:04.969481    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:05.037347 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:05.037312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:05.226951 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:05.226835    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-g7pmp" podStartSLOduration=3.712803869 podStartE2EDuration="6.226821056s" totalImagesPullingTime="2.514017187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:05.225878564 +0000 UTC m=+40.803473444" watchObservedRunningTime="2026-07-28 17:23:05.226821056 +0000 UTC m=+40.804415933"
Jul 28 17:23:07.640148 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:07.640104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:07.640148 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:07.640155    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:07.640668 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:07.640282    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:23:07.640668 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:07.640285    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:23:07.640668 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:07.640306    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dbc6566-xcvbc: secret "image-registry-tls" not found
Jul 28 17:23:07.640668 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:07.640338    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls podName:dceaf718-af8e-484c-b1ef-5b7fa813199d nodeName:}" failed. No retries permitted until 2026-07-28 17:23:15.640322302 +0000 UTC m=+51.217917157 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls") pod "dns-default-hfjmc" (UID: "dceaf718-af8e-484c-b1ef-5b7fa813199d") : secret "dns-default-metrics-tls" not found
Jul 28 17:23:07.640668 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:07.640365    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls podName:8b60ddbe-5677-4a56-9ac8-9c05573e5d33 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:15.640347999 +0000 UTC m=+51.217942878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls") pod "image-registry-644dbc6566-xcvbc" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33") : secret "image-registry-tls" not found
Jul 28 17:23:09.467580 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:09.467525    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:09.537352 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:09.537317    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:09.627487 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:09.627458    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:09.697870 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:09.697838    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:15.699019 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:15.698982    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:15.699415 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:15.699028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:15.699415 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:15.699178    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:23:15.699415 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:15.699202    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dbc6566-xcvbc: secret "image-registry-tls" not found
Jul 28 17:23:15.699415 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:15.699246    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:23:15.699415 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:15.699268    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls podName:8b60ddbe-5677-4a56-9ac8-9c05573e5d33 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:31.699250729 +0000 UTC m=+67.276845585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls") pod "image-registry-644dbc6566-xcvbc" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33") : secret "image-registry-tls" not found
Jul 28 17:23:15.699415 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:15.699323    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls podName:dceaf718-af8e-484c-b1ef-5b7fa813199d nodeName:}" failed. No retries permitted until 2026-07-28 17:23:31.699305066 +0000 UTC m=+67.276899923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls") pod "dns-default-hfjmc" (UID: "dceaf718-af8e-484c-b1ef-5b7fa813199d") : secret "dns-default-metrics-tls" not found
Jul 28 17:23:20.940975 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:20.940936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:21.076900 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:21.076866    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:21.177550 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:21.177522    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:21.999384 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:21.999349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:22.079259 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:22.079224    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:26.030066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:26.030029    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:26.176789 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:26.176757    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gglbf"
Jul 28 17:23:27.649493 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:27.649459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:30.608763 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.608726    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:23:30.608763 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.608775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:23:30.611479 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.611457    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 17:23:30.611584 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.611461    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 17:23:30.619481 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:30.619449    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 17:23:30.619541 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:30.619525    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs podName:ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:34.619506912 +0000 UTC m=+130.197101768 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs") pod "network-metrics-daemon-jzkgz" (UID: "ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1") : secret "metrics-daemon-secret" not found
Jul 28 17:23:30.623504 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.623477    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b791044-ec01-4361-a7af-94b280ecf848-original-pull-secret\") pod \"global-pull-secret-syncer-rzmd7\" (UID: \"4b791044-ec01-4361-a7af-94b280ecf848\") " pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:23:30.806731 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.806695    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rzmd7"
Jul 28 17:23:30.810567 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.810544    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:23:30.813154 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.813128    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 17:23:30.823908 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.823881    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 17:23:30.834382 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.834346    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d2mj\" (UniqueName: \"kubernetes.io/projected/f7e44ae8-d853-432d-bef5-b4c774613c7d-kube-api-access-8d2mj\") pod \"network-check-target-7lpnq\" (UID: \"f7e44ae8-d853-432d-bef5-b4c774613c7d\") " pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:23:30.952274 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:30.952225    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rzmd7"]
Jul 28 17:23:30.957908 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:23:30.957879    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b791044_ec01_4361_a7af_94b280ecf848.slice/crio-1180575e7284b8b283b25c3f73ddabdd377d1034865c19248764759cd172894f WatchSource:0}: Error finding container 1180575e7284b8b283b25c3f73ddabdd377d1034865c19248764759cd172894f: Status 404 returned error can't find the container with id 1180575e7284b8b283b25c3f73ddabdd377d1034865c19248764759cd172894f
Jul 28 17:23:31.116736 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.116708    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-27qqv\""
Jul 28 17:23:31.124852 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.124813    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:23:31.254707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.254669    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7lpnq"]
Jul 28 17:23:31.257765 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:23:31.257734    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e44ae8_d853_432d_bef5_b4c774613c7d.slice/crio-29c108355d445b3d38721193dd52572bec4747629784b5367db294392d623bc9 WatchSource:0}: Error finding container 29c108355d445b3d38721193dd52572bec4747629784b5367db294392d623bc9: Status 404 returned error can't find the container with id 29c108355d445b3d38721193dd52572bec4747629784b5367db294392d623bc9
Jul 28 17:23:31.268853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.268819    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lpnq" event={"ID":"f7e44ae8-d853-432d-bef5-b4c774613c7d","Type":"ContainerStarted","Data":"29c108355d445b3d38721193dd52572bec4747629784b5367db294392d623bc9"}
Jul 28 17:23:31.269793 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.269771    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rzmd7" event={"ID":"4b791044-ec01-4361-a7af-94b280ecf848","Type":"ContainerStarted","Data":"1180575e7284b8b283b25c3f73ddabdd377d1034865c19248764759cd172894f"}
Jul 28 17:23:31.437090 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.436936    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:31.535019 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.534983    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:31.721974 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.721889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:23:31.721974 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:31.721932    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:23:31.722471 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:31.722060    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:23:31.722471 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:31.722068    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:23:31.722471 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:31.722092    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dbc6566-xcvbc: secret "image-registry-tls" not found
Jul 28 17:23:31.722471 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:31.722123    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls podName:dceaf718-af8e-484c-b1ef-5b7fa813199d nodeName:}" failed. No retries permitted until 2026-07-28 17:24:03.722104624 +0000 UTC m=+99.299699499 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls") pod "dns-default-hfjmc" (UID: "dceaf718-af8e-484c-b1ef-5b7fa813199d") : secret "dns-default-metrics-tls" not found
Jul 28 17:23:31.722471 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:31.722151    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls podName:8b60ddbe-5677-4a56-9ac8-9c05573e5d33 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:03.722131342 +0000 UTC m=+99.299726201 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls") pod "image-registry-644dbc6566-xcvbc" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33") : secret "image-registry-tls" not found
Jul 28 17:23:32.952181 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:32.952144    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:33.052373 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:33.052329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:36.287463 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:36.287424    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7lpnq" event={"ID":"f7e44ae8-d853-432d-bef5-b4c774613c7d","Type":"ContainerStarted","Data":"64d0414334b86445dcc46f4a524cef1ae8213684995135b706ad9eb88344dd34"}
Jul 28 17:23:36.287921 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:36.287526    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:23:36.288750 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:36.288730    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rzmd7" event={"ID":"4b791044-ec01-4361-a7af-94b280ecf848","Type":"ContainerStarted","Data":"0226555c4a1f7596f6adc39b4be96ba5256c96de136a87e10e12ec5a960fe10c"}
Jul 28 17:23:36.305114 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:36.305058    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7lpnq" podStartSLOduration=65.779623633 podStartE2EDuration="1m10.305042015s" totalImagesPullingTime="4.525418382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:36.304174916 +0000 UTC m=+71.881769794" watchObservedRunningTime="2026-07-28 17:23:36.305042015 +0000 UTC m=+71.882636893"
Jul 28 17:23:36.320548 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:36.320494    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rzmd7" podStartSLOduration=65.490195063 podStartE2EDuration="1m10.320478092s" totalImagesPullingTime="4.830283029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:36.319977037 +0000 UTC m=+71.897571914" watchObservedRunningTime="2026-07-28 17:23:36.320478092 +0000 UTC m=+71.898072969"
Jul 28 17:23:37.067200 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:37.067165    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:37.131142 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:37.131110    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:37.484864 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:37.484833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:37.548714 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:37.548681    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:54.427355 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.427209    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"]
Jul 28 17:23:54.430072 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.430047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.431165 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.431145    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-788fb89859-4pbk2"]
Jul 28 17:23:54.433012 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.432996    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.438472 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.438453    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 17:23:54.438581 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.438554    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 17:23:54.438660 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.438594    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 17:23:54.438828 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.438812    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j4r9p\""
Jul 28 17:23:54.438906 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.438848    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 17:23:54.439094 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.439080    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 17:23:54.439160 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.439142    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 17:23:54.439481 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.439461    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 17:23:54.439547 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.439500    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 17:23:54.439737 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.439723    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5pnb2\""
Jul 28 17:23:54.439801 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.439725    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 17:23:54.439940 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.439929    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 17:23:54.443314 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.443270    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"]
Jul 28 17:23:54.452265 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.452237    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-788fb89859-4pbk2"]
Jul 28 17:23:54.480693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.480658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdxf2\" (UniqueName: \"kubernetes.io/projected/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-kube-api-access-fdxf2\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.480894 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.480705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3865dd9b-7911-4b3a-bac0-d13542476989-config\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.480894 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.480724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t78rb\" (UniqueName: \"kubernetes.io/projected/3865dd9b-7911-4b3a-bac0-d13542476989-kube-api-access-t78rb\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.480894 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.480797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-default-certificate\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.480894 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.480837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-stats-auth\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.480894 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.480877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.481110 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.480911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3865dd9b-7911-4b3a-bac0-d13542476989-serving-cert\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.481110 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.480958    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.581853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.581815    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.582057 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.581858    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3865dd9b-7911-4b3a-bac0-d13542476989-serving-cert\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.582057 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.581896    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.582057 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.581959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdxf2\" (UniqueName: \"kubernetes.io/projected/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-kube-api-access-fdxf2\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.582057 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:54.581976    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 17:23:54.582250 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:54.582070    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:23:55.082053497 +0000 UTC m=+90.659648372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : secret "router-metrics-certs-default" not found
Jul 28 17:23:54.582250 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.582090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3865dd9b-7911-4b3a-bac0-d13542476989-config\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.582250 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.582117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t78rb\" (UniqueName: \"kubernetes.io/projected/3865dd9b-7911-4b3a-bac0-d13542476989-kube-api-access-t78rb\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.582250 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:54.582137    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:23:55.082123223 +0000 UTC m=+90.659718101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : configmap references non-existent config key: service-ca.crt
Jul 28 17:23:54.582250 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.582178    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-default-certificate\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.582250 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.582205    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-stats-auth\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.582694 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.582665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3865dd9b-7911-4b3a-bac0-d13542476989-config\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.584300 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.584270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3865dd9b-7911-4b3a-bac0-d13542476989-serving-cert\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.584542 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.584524    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-stats-auth\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.584687 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.584599    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-default-certificate\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.589523 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.589485    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:54.591024 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.591001    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t78rb\" (UniqueName: \"kubernetes.io/projected/3865dd9b-7911-4b3a-bac0-d13542476989-kube-api-access-t78rb\") pod \"service-ca-operator-5d6c75f84f-nn267\" (UID: \"3865dd9b-7911-4b3a-bac0-d13542476989\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.591254 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.591234    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdxf2\" (UniqueName: \"kubernetes.io/projected/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-kube-api-access-fdxf2\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:54.689350 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.689259    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:54.740886 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.740852    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"
Jul 28 17:23:54.868560 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:54.868532    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267"]
Jul 28 17:23:54.872058 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:23:54.872030    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3865dd9b_7911_4b3a_bac0_d13542476989.slice/crio-1c0c64a2190ccd91f2d639819a6caba767837e127de286f61fd96ad8ee6513d6 WatchSource:0}: Error finding container 1c0c64a2190ccd91f2d639819a6caba767837e127de286f61fd96ad8ee6513d6: Status 404 returned error can't find the container with id 1c0c64a2190ccd91f2d639819a6caba767837e127de286f61fd96ad8ee6513d6
Jul 28 17:23:55.086699 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:55.086560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:55.086699 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:55.086661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:55.086887 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:55.086723    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 17:23:55.086887 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:55.086794    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:23:56.086778689 +0000 UTC m=+91.664373544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : configmap references non-existent config key: service-ca.crt
Jul 28 17:23:55.086887 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:55.086810    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:23:56.086802786 +0000 UTC m=+91.664397642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : secret "router-metrics-certs-default" not found
Jul 28 17:23:55.337174 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:55.337092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267" event={"ID":"3865dd9b-7911-4b3a-bac0-d13542476989","Type":"ContainerStarted","Data":"1c0c64a2190ccd91f2d639819a6caba767837e127de286f61fd96ad8ee6513d6"}
Jul 28 17:23:56.095034 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:56.094990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:56.095483 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:56.095088    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:56.095483 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:56.095175    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 17:23:56.095483 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:56.095217    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:23:58.095189783 +0000 UTC m=+93.672784658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : configmap references non-existent config key: service-ca.crt
Jul 28 17:23:56.095483 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:56.095249    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:23:58.095238837 +0000 UTC m=+93.672833693 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : secret "router-metrics-certs-default" not found
Jul 28 17:23:56.114047 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:56.114011    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:56.248763 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:56.248727    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:57.343700 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:57.343665    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267" event={"ID":"3865dd9b-7911-4b3a-bac0-d13542476989","Type":"ContainerStarted","Data":"c1a2e8b98e7557f8decf556d233d09d801da07697da50fb70f560a2cf33fd3e1"}
Jul 28 17:23:57.361984 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:57.361919    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267" podStartSLOduration=1.435709642 podStartE2EDuration="3.361896897s" totalImagesPullingTime="1.926187255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:23:57.360930726 +0000 UTC m=+92.938525607" watchObservedRunningTime="2026-07-28 17:23:57.361896897 +0000 UTC m=+92.939491779"
Jul 28 17:23:57.979507 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:57.979468    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:58.113303 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.113245    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:58.113482 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.113370    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:23:58.113482 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:58.113391    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:24:02.113369159 +0000 UTC m=+97.690964037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : configmap references non-existent config key: service-ca.crt
Jul 28 17:23:58.113482 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:58.113453    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 17:23:58.113587 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:58.113491    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:24:02.113483157 +0000 UTC m=+97.691078016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : secret "router-metrics-certs-default" not found
Jul 28 17:23:58.427598 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.427560    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:58.485954 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.485917    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:58.690634 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.690521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:58.737592 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.737557    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pb7j9"]
Jul 28 17:23:58.739736 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.739717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.743125 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.743102    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 17:23:58.743311 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.743291    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 17:23:58.743498 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.743479    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hw8gz\""
Jul 28 17:23:58.743606 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.743550    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 17:23:58.743987 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.743968    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 17:23:58.753821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.753791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pb7j9"]
Jul 28 17:23:58.773751 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.773708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:58.819877 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.819829    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-crio-socket\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.820057 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.819943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.820057 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.819981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-data-volume\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.820057 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.820025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.820057 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.820049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sth4m\" (UniqueName: \"kubernetes.io/projected/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-api-access-sth4m\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.852074 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.852039    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:58.921092 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.921051    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.921092 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.921095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sth4m\" (UniqueName: \"kubernetes.io/projected/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-api-access-sth4m\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.921362 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:58.921182    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:23:58.921362 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:58.921271    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:59.421238965 +0000 UTC m=+94.998833834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : configmap "kube-rbac-proxy" not found
Jul 28 17:23:58.921362 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.921348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-crio-socket\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.921529 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.921423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.921529 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.921456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-crio-socket\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.921529 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.921459    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-data-volume\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.921704 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:58.921542    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:23:58.921704 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:58.921597    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:23:59.42158266 +0000 UTC m=+94.999177528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:23:58.921771 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.921739    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-data-volume\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:58.934497 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:58.934466    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sth4m\" (UniqueName: \"kubernetes.io/projected/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-api-access-sth4m\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:59.046875 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.046800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:59.150131 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.150099    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:59.251574 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.251543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:59.320967 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.320892    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:23:59.339304 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.339240    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8"]
Jul 28 17:23:59.341190 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.341174    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8"
Jul 28 17:23:59.343881 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.343859    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4fx2b\""
Jul 28 17:23:59.354526 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.354492    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8"]
Jul 28 17:23:59.425956 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.425918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:59.426121 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.425978    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdkwf\" (UniqueName: \"kubernetes.io/projected/ceee7b56-e106-4037-809a-563131bc990b-kube-api-access-mdkwf\") pod \"network-check-source-7d88cb55d8-f75b8\" (UID: \"ceee7b56-e106-4037-809a-563131bc990b\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8"
Jul 28 17:23:59.426121 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.426005    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:23:59.426121 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:59.426057    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:23:59.426224 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:59.426123    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:00.426107264 +0000 UTC m=+96.003702123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:23:59.426224 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:59.426181    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:23:59.426292 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:23:59.426229    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:00.426216578 +0000 UTC m=+96.003811435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : configmap "kube-rbac-proxy" not found
Jul 28 17:23:59.527219 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.527174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdkwf\" (UniqueName: \"kubernetes.io/projected/ceee7b56-e106-4037-809a-563131bc990b-kube-api-access-mdkwf\") pod \"network-check-source-7d88cb55d8-f75b8\" (UID: \"ceee7b56-e106-4037-809a-563131bc990b\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8"
Jul 28 17:23:59.536288 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.536252    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdkwf\" (UniqueName: \"kubernetes.io/projected/ceee7b56-e106-4037-809a-563131bc990b-kube-api-access-mdkwf\") pod \"network-check-source-7d88cb55d8-f75b8\" (UID: \"ceee7b56-e106-4037-809a-563131bc990b\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8"
Jul 28 17:23:59.653659 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.653599    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8"
Jul 28 17:23:59.780152 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:23:59.780116    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8"]
Jul 28 17:23:59.783564 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:23:59.783536    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceee7b56_e106_4037_809a_563131bc990b.slice/crio-01b09101d297c2cada2192b3061e47e4b60eb9d48011a4bc6bb2fb8a4767ef04 WatchSource:0}: Error finding container 01b09101d297c2cada2192b3061e47e4b60eb9d48011a4bc6bb2fb8a4767ef04: Status 404 returned error can't find the container with id 01b09101d297c2cada2192b3061e47e4b60eb9d48011a4bc6bb2fb8a4767ef04
Jul 28 17:24:00.185840 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.185804    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt"]
Jul 28 17:24:00.187897 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.187879    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt"
Jul 28 17:24:00.190291 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.190244    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 17:24:00.190561 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.190542    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 17:24:00.190625 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.190584    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hcqlx\""
Jul 28 17:24:00.199087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.199061    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt"]
Jul 28 17:24:00.237260 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.237226    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:00.334572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.334538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8b6z\" (UniqueName: \"kubernetes.io/projected/a4b26e1e-6d56-42a4-8e1a-444211794c96-kube-api-access-t8b6z\") pod \"migrator-6865c9967-vnfdt\" (UID: \"a4b26e1e-6d56-42a4-8e1a-444211794c96\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt"
Jul 28 17:24:00.352439 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.352404    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:00.355241 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.355205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8" event={"ID":"ceee7b56-e106-4037-809a-563131bc990b","Type":"ContainerStarted","Data":"1ada2cb748aa6b1d130505d1b2d475c9e6b88418e19e889f83456acf8b521360"}
Jul 28 17:24:00.355385 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.355268    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8" event={"ID":"ceee7b56-e106-4037-809a-563131bc990b","Type":"ContainerStarted","Data":"01b09101d297c2cada2192b3061e47e4b60eb9d48011a4bc6bb2fb8a4767ef04"}
Jul 28 17:24:00.435379 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.435341    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:00.435379 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.435383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8b6z\" (UniqueName: \"kubernetes.io/projected/a4b26e1e-6d56-42a4-8e1a-444211794c96-kube-api-access-t8b6z\") pod \"migrator-6865c9967-vnfdt\" (UID: \"a4b26e1e-6d56-42a4-8e1a-444211794c96\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt"
Jul 28 17:24:00.435603 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.435441    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:00.435603 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:00.435505    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:24:00.435603 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:00.435527    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:24:00.435603 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:00.435571    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:02.435553074 +0000 UTC m=+98.013147934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:24:00.435603 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:00.435585    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:02.435578681 +0000 UTC m=+98.013173536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : configmap "kube-rbac-proxy" not found
Jul 28 17:24:00.447928 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.447848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8b6z\" (UniqueName: \"kubernetes.io/projected/a4b26e1e-6d56-42a4-8e1a-444211794c96-kube-api-access-t8b6z\") pod \"migrator-6865c9967-vnfdt\" (UID: \"a4b26e1e-6d56-42a4-8e1a-444211794c96\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt"
Jul 28 17:24:00.455880 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.455851    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:00.497003 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.496964    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt"
Jul 28 17:24:00.543571 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.543535    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-phdpq_b9300d83-29e9-46dd-9817-a33dae58c8e8/dns-node-resolver/0.log"
Jul 28 17:24:00.630777 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.630725    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-f75b8" podStartSLOduration=1.630705869 podStartE2EDuration="1.630705869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:00.388999849 +0000 UTC m=+95.966594732" watchObservedRunningTime="2026-07-28 17:24:00.630705869 +0000 UTC m=+96.208300746"
Jul 28 17:24:00.631312 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:00.631296    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt"]
Jul 28 17:24:00.634200 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:00.634170    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b26e1e_6d56_42a4_8e1a_444211794c96.slice/crio-a7778ba67c45c42d4ea4e135e89fbf934fb3b280a967b64844b330d0dea4e977 WatchSource:0}: Error finding container a7778ba67c45c42d4ea4e135e89fbf934fb3b280a967b64844b330d0dea4e977: Status 404 returned error can't find the container with id a7778ba67c45c42d4ea4e135e89fbf934fb3b280a967b64844b330d0dea4e977
Jul 28 17:24:01.336436 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:01.336401    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:01.359515 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:01.359473    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt" event={"ID":"a4b26e1e-6d56-42a4-8e1a-444211794c96","Type":"ContainerStarted","Data":"a7778ba67c45c42d4ea4e135e89fbf934fb3b280a967b64844b330d0dea4e977"}
Jul 28 17:24:01.743952 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:01.743920    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-86vmd_6df1c290-c341-40cc-9644-82a9a471aa55/node-ca/0.log"
Jul 28 17:24:02.148752 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:02.148712    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:02.148953 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:02.148798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:02.148953 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:02.148885    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:24:10.148862327 +0000 UTC m=+105.726457255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : configmap references non-existent config key: service-ca.crt
Jul 28 17:24:02.148953 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:02.148929    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 17:24:02.149064 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:02.148981    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs podName:1865e52e-e8a6-4af7-abcf-fe9518e45bfd nodeName:}" failed. No retries permitted until 2026-07-28 17:24:10.148969088 +0000 UTC m=+105.726563944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs") pod "router-default-788fb89859-4pbk2" (UID: "1865e52e-e8a6-4af7-abcf-fe9518e45bfd") : secret "router-metrics-certs-default" not found
Jul 28 17:24:02.367434 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:02.367399    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt" event={"ID":"a4b26e1e-6d56-42a4-8e1a-444211794c96","Type":"ContainerStarted","Data":"7307b5a7bbc2d98d79a7099afb1368d303358518acb4fc591e14ffb8b500177c"}
Jul 28 17:24:02.367581 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:02.367459    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt" event={"ID":"a4b26e1e-6d56-42a4-8e1a-444211794c96","Type":"ContainerStarted","Data":"47684e5f92a14573b58b76e5b53188289040a802641cfbf26709cdb146a6275f"}
Jul 28 17:24:02.388298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:02.388245    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-vnfdt" podStartSLOduration=1.191469269 podStartE2EDuration="2.388226477s" totalImagesPullingTime="1.196757208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:02.387428971 +0000 UTC m=+97.965023847" watchObservedRunningTime="2026-07-28 17:24:02.388226477 +0000 UTC m=+97.965821354"
Jul 28 17:24:02.451774 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:02.451685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:02.451941 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:02.451779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:02.451941 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:02.451807    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:24:02.451941 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:02.451878    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:06.451857996 +0000 UTC m=+102.029452855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : configmap "kube-rbac-proxy" not found
Jul 28 17:24:02.451941 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:02.451920    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:24:02.452096 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:02.451973    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:06.451960086 +0000 UTC m=+102.029554956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:24:02.546844 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:02.546774    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g7pmp_123ab06e-cb59-4cef-a66e-50dd483a4721/serve-healthcheck-canary/0.log"
Jul 28 17:24:03.767170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:03.767118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:24:03.767573 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:03.767232    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") pod \"image-registry-644dbc6566-xcvbc\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") " pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:24:03.767573 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:03.767269    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 17:24:03.767573 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:03.767332    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls podName:dceaf718-af8e-484c-b1ef-5b7fa813199d nodeName:}" failed. No retries permitted until 2026-07-28 17:25:07.767316831 +0000 UTC m=+163.344911688 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls") pod "dns-default-hfjmc" (UID: "dceaf718-af8e-484c-b1ef-5b7fa813199d") : secret "dns-default-metrics-tls" not found
Jul 28 17:24:03.767573 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:03.767347    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 17:24:03.767573 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:03.767358    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-644dbc6566-xcvbc: secret "image-registry-tls" not found
Jul 28 17:24:03.767573 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:03.767402    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls podName:8b60ddbe-5677-4a56-9ac8-9c05573e5d33 nodeName:}" failed. No retries permitted until 2026-07-28 17:25:07.767386411 +0000 UTC m=+163.344981287 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls") pod "image-registry-644dbc6566-xcvbc" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33") : secret "image-registry-tls" not found
Jul 28 17:24:03.775402 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:03.775376    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:03.924040 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:03.924009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:04.079413 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:04.079335    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:04.184870 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:04.184839    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:04.284776 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:04.284746    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:04.471480 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:04.471447    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:04.572440 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:04.572408    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:05.080943 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:05.080907    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:05.673474 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:05.673434    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:06.276973 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:06.276939    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:06.479245 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:06.479192    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:06.488387 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:06.488358    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:06.488481 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:06.488409    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:06.488531 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:06.488508    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 17:24:06.488531 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:06.488522    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 17:24:06.488602 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:06.488571    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:14.488554803 +0000 UTC m=+110.066149662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : secret "insights-runtime-extractor-tls" not found
Jul 28 17:24:06.488602 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:06.488586    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm podName:4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:14.488579047 +0000 UTC m=+110.066173903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pb7j9" (UID: "4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2") : configmap "kube-rbac-proxy" not found
Jul 28 17:24:06.679968 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:06.679921    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:06.878288 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:06.878241    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:07.294018 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:07.293986    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7lpnq"
Jul 28 17:24:07.478395 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:07.478360    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:07.668024 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:07.667990    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:07.830895 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:07.830862    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:07.928854 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:07.928756    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:08.669855 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:08.669814    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:08.876378 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:08.876306    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:09.279995 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:09.279922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:09.483550 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:09.483517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:09.876929 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:09.876897    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:09.935649 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:09.935606    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:10.219875 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:10.219769    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:10.220098 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:10.219889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:10.220443 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:10.220410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-service-ca-bundle\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:10.222378 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:10.222353    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1865e52e-e8a6-4af7-abcf-fe9518e45bfd-metrics-certs\") pod \"router-default-788fb89859-4pbk2\" (UID: \"1865e52e-e8a6-4af7-abcf-fe9518e45bfd\") " pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:10.345851 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:10.345804    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:10.473711 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:10.473626    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:10.479759 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:10.479722    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-788fb89859-4pbk2"]
Jul 28 17:24:10.483487 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:10.483458    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1865e52e_e8a6_4af7_abcf_fe9518e45bfd.slice/crio-3f0b75e6e277da779fed6a302fb20545774a3a6e7183b9110352682ce0cccb97 WatchSource:0}: Error finding container 3f0b75e6e277da779fed6a302fb20545774a3a6e7183b9110352682ce0cccb97: Status 404 returned error can't find the container with id 3f0b75e6e277da779fed6a302fb20545774a3a6e7183b9110352682ce0cccb97
Jul 28 17:24:11.069330 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:11.069294    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:11.270938 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:11.270895    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:11.398283 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:11.398246    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-788fb89859-4pbk2" event={"ID":"1865e52e-e8a6-4af7-abcf-fe9518e45bfd","Type":"ContainerStarted","Data":"fa28e590b02a244d9efb2f642bad5d1877f80c0fb050bbcb7dd354bfb74d4e22"}
Jul 28 17:24:11.398637 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:11.398293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-788fb89859-4pbk2" event={"ID":"1865e52e-e8a6-4af7-abcf-fe9518e45bfd","Type":"ContainerStarted","Data":"3f0b75e6e277da779fed6a302fb20545774a3a6e7183b9110352682ce0cccb97"}
Jul 28 17:24:11.422412 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:11.422351    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-788fb89859-4pbk2" podStartSLOduration=17.422336009 podStartE2EDuration="17.422336009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:11.420637035 +0000 UTC m=+106.998231914" watchObservedRunningTime="2026-07-28 17:24:11.422336009 +0000 UTC m=+106.999930887"
Jul 28 17:24:11.658043 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:11.657962    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:11.765049 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:11.765014    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:11.877353 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:11.877324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:12.276501 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:12.276463    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:12.346648 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:12.346590    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:12.349149 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:12.349124    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:12.401880 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:12.401855    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:12.403046 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:12.403023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-788fb89859-4pbk2"
Jul 28 17:24:12.674064 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:12.674031    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:13.086508 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:13.086392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:13.170976 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:13.170930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:13.683379 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:13.683297    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:14.085126 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.085034    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:14.273546 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.273512    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:14.471034 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.471001    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:14.555023 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.554980    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:14.555212 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.555132    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:14.555685 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.555667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:14.557465 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.557447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pb7j9\" (UID: \"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2\") " pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:14.648754 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.648718    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pb7j9"
Jul 28 17:24:14.782300 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:14.782265    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pb7j9"]
Jul 28 17:24:14.785002 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:14.784976    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2e72a7_d6cb_4286_a54d_4dbe74eb38f2.slice/crio-303afd82daeb13898a444ecaef6c4f89b407a632a398ab31d9c9d2566b9dabc0 WatchSource:0}: Error finding container 303afd82daeb13898a444ecaef6c4f89b407a632a398ab31d9c9d2566b9dabc0: Status 404 returned error can't find the container with id 303afd82daeb13898a444ecaef6c4f89b407a632a398ab31d9c9d2566b9dabc0
Jul 28 17:24:15.412597 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:15.412553    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pb7j9" event={"ID":"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2","Type":"ContainerStarted","Data":"303afd82daeb13898a444ecaef6c4f89b407a632a398ab31d9c9d2566b9dabc0"}
Jul 28 17:24:20.432800 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:20.432752    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pb7j9" event={"ID":"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2","Type":"ContainerStarted","Data":"8e544d52af4510f07831d42bf1f0805cd675252f19055c5012f48f5aed39e45e"}
Jul 28 17:24:20.753899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:20.753819    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:20.845536 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:20.845507    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:23.445017 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:23.444924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pb7j9" event={"ID":"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2","Type":"ContainerStarted","Data":"baefb4f8469f6157867564f15d0f8b23bf5d0bcbaac7d34c2a05e81b336d9374"}
Jul 28 17:24:24.329261 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:24.329218    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:24.393455 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:24.393411    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:24.649369 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:24.649324    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:24.723186 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:24.723142    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:27.459291 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:27.459258    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pb7j9" event={"ID":"4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2","Type":"ContainerStarted","Data":"dd95a6cb0c81dfaad1bc440633edb41936a443419fcc7abe93dc0e580ff8ad8e"}
Jul 28 17:24:27.505545 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:27.505488    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pb7j9" podStartSLOduration=17.610704006 podStartE2EDuration="29.505473252s" totalImagesPullingTime="11.894769246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:23:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:27.504991322 +0000 UTC m=+123.082586201" watchObservedRunningTime="2026-07-28 17:24:27.505473252 +0000 UTC m=+123.083068180"
Jul 28 17:24:29.439976 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.439944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:29.541391 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.541353    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:29.603774 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.603738    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"]
Jul 28 17:24:29.605870 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.605849    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"
Jul 28 17:24:29.608341 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.608317    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 17:24:29.608447 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.608328    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z6452\""
Jul 28 17:24:29.617597 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.617568    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"]
Jul 28 17:24:29.625283 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.625255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:29.673970 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.673929    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1d80833-a013-4c48-a14d-6e9d41b33117-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-gqd9k\" (UID: \"a1d80833-a013-4c48-a14d-6e9d41b33117\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"
Jul 28 17:24:29.774809 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:29.774713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1d80833-a013-4c48-a14d-6e9d41b33117-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-gqd9k\" (UID: \"a1d80833-a013-4c48-a14d-6e9d41b33117\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"
Jul 28 17:24:29.775004 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:29.774893    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 17:24:29.775004 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:29.774974    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d80833-a013-4c48-a14d-6e9d41b33117-tls-certificates podName:a1d80833-a013-4c48-a14d-6e9d41b33117 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:30.274953596 +0000 UTC m=+125.852548468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a1d80833-a013-4c48-a14d-6e9d41b33117-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-gqd9k" (UID: "a1d80833-a013-4c48-a14d-6e9d41b33117") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 17:24:30.196452 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:30.196418    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:30.278311 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:30.278276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1d80833-a013-4c48-a14d-6e9d41b33117-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-gqd9k\" (UID: \"a1d80833-a013-4c48-a14d-6e9d41b33117\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"
Jul 28 17:24:30.280694 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:30.280668    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1d80833-a013-4c48-a14d-6e9d41b33117-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-gqd9k\" (UID: \"a1d80833-a013-4c48-a14d-6e9d41b33117\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"
Jul 28 17:24:30.515726 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:30.515634    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"
Jul 28 17:24:30.639141 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:30.639107    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"]
Jul 28 17:24:30.641943 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:30.641917    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d80833_a013_4c48_a14d_6e9d41b33117.slice/crio-42ca381856bafbf6fa250179c37e439a3129b136923b7224a6574cd3631b39ef WatchSource:0}: Error finding container 42ca381856bafbf6fa250179c37e439a3129b136923b7224a6574cd3631b39ef: Status 404 returned error can't find the container with id 42ca381856bafbf6fa250179c37e439a3129b136923b7224a6574cd3631b39ef
Jul 28 17:24:31.473237 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:31.473195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k" event={"ID":"a1d80833-a013-4c48-a14d-6e9d41b33117","Type":"ContainerStarted","Data":"42ca381856bafbf6fa250179c37e439a3129b136923b7224a6574cd3631b39ef"}
Jul 28 17:24:31.669754 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:31.669723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:32.477929 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.477893    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k" event={"ID":"a1d80833-a013-4c48-a14d-6e9d41b33117","Type":"ContainerStarted","Data":"3dc8f3e14f74afb8325a427df59777516d8c6410e82025729f98a1d47256718e"}
Jul 28 17:24:32.478161 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.478089    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"
Jul 28 17:24:32.482722 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.482693    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k"
Jul 28 17:24:32.496280 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.496228    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-gqd9k" podStartSLOduration=2.488285839 podStartE2EDuration="3.49620998s" totalImagesPullingTime="1.007924141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:32.494034153 +0000 UTC m=+128.071629031" watchObservedRunningTime="2026-07-28 17:24:32.49620998 +0000 UTC m=+128.073804859"
Jul 28 17:24:32.634448 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.634420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:32.687715 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.687687    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"]
Jul 28 17:24:32.692303 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.692271    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.695067 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.695032    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 17:24:32.695067 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.695032    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 17:24:32.695268 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.695032    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 17:24:32.695327 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.695266    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-flh8s\""
Jul 28 17:24:32.695414 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.695399    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 17:24:32.695662 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.695647    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 17:24:32.703146 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.703119    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"]
Jul 28 17:24:32.712350 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.712325    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:32.798252 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.798160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f448d3-6467-48a8-91e0-afbf1c15ee27-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.798252 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.798200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f448d3-6467-48a8-91e0-afbf1c15ee27-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.798435 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.798277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/70f448d3-6467-48a8-91e0-afbf1c15ee27-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.798435 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.798359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2pqx\" (UniqueName: \"kubernetes.io/projected/70f448d3-6467-48a8-91e0-afbf1c15ee27-kube-api-access-t2pqx\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.816515 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.816487    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:32.898989 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.898963    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2pqx\" (UniqueName: \"kubernetes.io/projected/70f448d3-6467-48a8-91e0-afbf1c15ee27-kube-api-access-t2pqx\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.899105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.898995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f448d3-6467-48a8-91e0-afbf1c15ee27-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.899105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.899015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f448d3-6467-48a8-91e0-afbf1c15ee27-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.899105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.899057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/70f448d3-6467-48a8-91e0-afbf1c15ee27-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.899631 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.899588    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f448d3-6467-48a8-91e0-afbf1c15ee27-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.901495 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.901469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/70f448d3-6467-48a8-91e0-afbf1c15ee27-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.901594 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.901491    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f448d3-6467-48a8-91e0-afbf1c15ee27-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:32.907985 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:32.907958    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2pqx\" (UniqueName: \"kubernetes.io/projected/70f448d3-6467-48a8-91e0-afbf1c15ee27-kube-api-access-t2pqx\") pod \"prometheus-operator-84d69f794d-mf6rf\" (UID: \"70f448d3-6467-48a8-91e0-afbf1c15ee27\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:33.001273 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:33.001236    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"
Jul 28 17:24:33.134064 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:33.133968    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-mf6rf"]
Jul 28 17:24:33.136419 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:33.136388    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f448d3_6467_48a8_91e0_afbf1c15ee27.slice/crio-df54f731854527a339830b8ab847c32e2c405b203380c609097cb5649e268f5c WatchSource:0}: Error finding container df54f731854527a339830b8ab847c32e2c405b203380c609097cb5649e268f5c: Status 404 returned error can't find the container with id df54f731854527a339830b8ab847c32e2c405b203380c609097cb5649e268f5c
Jul 28 17:24:33.482026 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:33.481993    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf" event={"ID":"70f448d3-6467-48a8-91e0-afbf1c15ee27","Type":"ContainerStarted","Data":"df54f731854527a339830b8ab847c32e2c405b203380c609097cb5649e268f5c"}
Jul 28 17:24:34.487302 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:34.487271    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf" event={"ID":"70f448d3-6467-48a8-91e0-afbf1c15ee27","Type":"ContainerStarted","Data":"e019ab5f58adda08ad3a7b60e3fe4f25f2f5cd27def9e7b025e7083d39c71c6d"}
Jul 28 17:24:34.656120 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:34.656038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:34.713269 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:34.713231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:24:34.715645 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:34.715604    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1-metrics-certs\") pod \"network-metrics-daemon-jzkgz\" (UID: \"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1\") " pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:24:34.722492 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:34.722464    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ztptx\""
Jul 28 17:24:34.730681 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:34.730652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jzkgz"
Jul 28 17:24:34.885871 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:34.885848    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jzkgz"]
Jul 28 17:24:34.889228 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:34.888736    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6cb7b0_9b28_42ba_a6a7_ab3cb35c9dd1.slice/crio-0c11abeb2e21a4c88b2de77439747ef9153aeaa1704d37a654a619e4972b0b9b WatchSource:0}: Error finding container 0c11abeb2e21a4c88b2de77439747ef9153aeaa1704d37a654a619e4972b0b9b: Status 404 returned error can't find the container with id 0c11abeb2e21a4c88b2de77439747ef9153aeaa1704d37a654a619e4972b0b9b
Jul 28 17:24:35.442098 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:35.442047    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:35.492713 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:35.492674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jzkgz" event={"ID":"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1","Type":"ContainerStarted","Data":"0c11abeb2e21a4c88b2de77439747ef9153aeaa1704d37a654a619e4972b0b9b"}
Jul 28 17:24:35.494314 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:35.494286    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf" event={"ID":"70f448d3-6467-48a8-91e0-afbf1c15ee27","Type":"ContainerStarted","Data":"da48b860a1641d2cc5cc5e7510a19be2358308083d639b61692edd3f0bf6102f"}
Jul 28 17:24:35.510153 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:35.510120    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:35.514725 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:35.514679    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-mf6rf" podStartSLOduration=2.287383588 podStartE2EDuration="3.514661022s" totalImagesPullingTime="1.227277434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:35.51299574 +0000 UTC m=+131.090590619" watchObservedRunningTime="2026-07-28 17:24:35.514661022 +0000 UTC m=+131.092255904"
Jul 28 17:24:36.499985 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:36.499947    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jzkgz" event={"ID":"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1","Type":"ContainerStarted","Data":"470d6dbf01914d2b892d210541d0706b9b4c5761da6e88c87911addd30aaa8d6"}
Jul 28 17:24:36.500381 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:36.500033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jzkgz" event={"ID":"ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1","Type":"ContainerStarted","Data":"75db79a097170a5045ea6cc7812f7a1a32b6329460373be04d5c677998f6888f"}
Jul 28 17:24:36.525352 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:36.525284    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jzkgz" podStartSLOduration=130.530113974 podStartE2EDuration="2m11.525266118s" totalImagesPullingTime="995.152144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:36.525084449 +0000 UTC m=+132.102679328" watchObservedRunningTime="2026-07-28 17:24:36.525266118 +0000 UTC m=+132.102860998"
Jul 28 17:24:36.640054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:36.640021    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:36.853124 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:36.853088    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:36.953154 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:36.953084    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:37.129702 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.129600    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"]
Jul 28 17:24:37.134142 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.134122    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.139707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.139663    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 17:24:37.140840 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.140820    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 17:24:37.143040 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.143021    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-784lq\""
Jul 28 17:24:37.143123 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.143025    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 17:24:37.168865 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.168833    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bmlcd"]
Jul 28 17:24:37.172900 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.172871    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.173324 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.173298    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"]
Jul 28 17:24:37.176558 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.176540    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 17:24:37.177071 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.177053    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 17:24:37.178008 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.177989    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dm6j5\""
Jul 28 17:24:37.183850 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.183828    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 17:24:37.191952 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.191931    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:37.234271 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234236    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc0e165e-19bc-412d-9e35-8358fd6331bd-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.234271 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234273    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-sys\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234519 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234302    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nscnb\" (UniqueName: \"kubernetes.io/projected/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-api-access-nscnb\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.234519 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-root\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234519 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234347    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234519 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.234519 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09324273-4fa4-4658-833d-9caa9f7eed82-metrics-client-ca\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234519 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234496    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8c6m\" (UniqueName: \"kubernetes.io/projected/09324273-4fa4-4658-833d-9caa9f7eed82-kube-api-access-d8c6m\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234586    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-textfile\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc0e165e-19bc-412d-9e35-8358fd6331bd-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.234853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.234853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-tls\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234768    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-wtmp\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.234853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.234812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.310426 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.310398    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:37.335521 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335484    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8c6m\" (UniqueName: \"kubernetes.io/projected/09324273-4fa4-4658-833d-9caa9f7eed82-kube-api-access-d8c6m\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.335693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-textfile\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.335693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335580    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc0e165e-19bc-412d-9e35-8358fd6331bd-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.335693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.335693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-tls\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.335693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335678    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-wtmp\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.335934 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:37.335795    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 17:24:37.335934 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335831    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-wtmp\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.335934 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335838    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.335934 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:37.335868    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-tls podName:09324273-4fa4-4658-833d-9caa9f7eed82 nodeName:}" failed. No retries permitted until 2026-07-28 17:24:37.835846418 +0000 UTC m=+133.413441294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-tls") pod "node-exporter-bmlcd" (UID: "09324273-4fa4-4658-833d-9caa9f7eed82") : secret "node-exporter-tls" not found
Jul 28 17:24:37.335934 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc0e165e-19bc-412d-9e35-8358fd6331bd-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335960    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-sys\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-textfile\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.335993    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nscnb\" (UniqueName: \"kubernetes.io/projected/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-api-access-nscnb\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336025    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-sys\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336031    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-root\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336067    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09324273-4fa4-4658-833d-9caa9f7eed82-root\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336081    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc0e165e-19bc-412d-9e35-8358fd6331bd-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336110    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.336187 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09324273-4fa4-4658-833d-9caa9f7eed82-metrics-client-ca\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336756 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336207    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336756 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-accelerators-collector-config\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336756 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336747    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09324273-4fa4-4658-833d-9caa9f7eed82-metrics-client-ca\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.336926 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc0e165e-19bc-412d-9e35-8358fd6331bd-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.336926 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.336804    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.338475 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.338452    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.338652 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.338636    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.338701 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.338677    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.345371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.345348    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nscnb\" (UniqueName: \"kubernetes.io/projected/bc0e165e-19bc-412d-9e35-8358fd6331bd-kube-api-access-nscnb\") pod \"kube-state-metrics-56d9f944b4-kd2cp\" (UID: \"bc0e165e-19bc-412d-9e35-8358fd6331bd\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.345547 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.345530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8c6m\" (UniqueName: \"kubernetes.io/projected/09324273-4fa4-4658-833d-9caa9f7eed82-kube-api-access-d8c6m\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.443099 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.442993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"
Jul 28 17:24:37.444560 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.444523    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:37.544041 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.544009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:37.582909 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.582870    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp"]
Jul 28 17:24:37.586420 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:37.586387    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0e165e_19bc_412d_9e35_8358fd6331bd.slice/crio-d28bd37f99818da5c1417790723347fd1764fbc8c78fe3624d221556536b55d2 WatchSource:0}: Error finding container d28bd37f99818da5c1417790723347fd1764fbc8c78fe3624d221556536b55d2: Status 404 returned error can't find the container with id d28bd37f99818da5c1417790723347fd1764fbc8c78fe3624d221556536b55d2
Jul 28 17:24:37.644241 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.644189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:37.840059 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.839975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-tls\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:37.840059 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.840043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:37.842260 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:37.842230    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09324273-4fa4-4658-833d-9caa9f7eed82-node-exporter-tls\") pod \"node-exporter-bmlcd\" (UID: \"09324273-4fa4-4658-833d-9caa9f7eed82\") " pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:38.043945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:38.043910    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:38.082605 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:38.082573    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bmlcd"
Jul 28 17:24:38.094824 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:38.094792    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09324273_4fa4_4658_833d_9caa9f7eed82.slice/crio-f58f50763ee576e0dbdab04cb050ebb985692829b390c7d2dcd86a1f586ccb66 WatchSource:0}: Error finding container f58f50763ee576e0dbdab04cb050ebb985692829b390c7d2dcd86a1f586ccb66: Status 404 returned error can't find the container with id f58f50763ee576e0dbdab04cb050ebb985692829b390c7d2dcd86a1f586ccb66
Jul 28 17:24:38.156557 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:38.156489    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:38.359865 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:38.359831    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:38.510052 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:38.510009    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp" event={"ID":"bc0e165e-19bc-412d-9e35-8358fd6331bd","Type":"ContainerStarted","Data":"d28bd37f99818da5c1417790723347fd1764fbc8c78fe3624d221556536b55d2"}
Jul 28 17:24:38.511312 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:38.511282    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmlcd" event={"ID":"09324273-4fa4-4658-833d-9caa9f7eed82","Type":"ContainerStarted","Data":"f58f50763ee576e0dbdab04cb050ebb985692829b390c7d2dcd86a1f586ccb66"}
Jul 28 17:24:39.517886 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:39.517846    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp" event={"ID":"bc0e165e-19bc-412d-9e35-8358fd6331bd","Type":"ContainerStarted","Data":"d0ade0c19c351f36fa15ec9ff32cc6922cee8fff801da86f5d18cc967214cb70"}
Jul 28 17:24:39.518367 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:39.517923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp" event={"ID":"bc0e165e-19bc-412d-9e35-8358fd6331bd","Type":"ContainerStarted","Data":"1f9fc7fce28227e1be72b866709c2e069208646f6f91bcd5fbc891782db5f9fc"}
Jul 28 17:24:39.518367 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:39.517952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp" event={"ID":"bc0e165e-19bc-412d-9e35-8358fd6331bd","Type":"ContainerStarted","Data":"16f61dd30f07028fa9b9f273cb441f39f48f2beb53ee77ab72811368a7e2c91a"}
Jul 28 17:24:39.519814 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:39.519783    2573 generic.go:356] "Generic (PLEG): container finished" podID="09324273-4fa4-4658-833d-9caa9f7eed82" containerID="f10818a9fc6f487c78e911d65e882ed61aafe89c3f90a13dd17d35a525b79da8" exitCode=0
Jul 28 17:24:39.520055 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:39.519827    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmlcd" event={"ID":"09324273-4fa4-4658-833d-9caa9f7eed82","Type":"ContainerDied","Data":"f10818a9fc6f487c78e911d65e882ed61aafe89c3f90a13dd17d35a525b79da8"}
Jul 28 17:24:39.544289 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:39.544233    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-kd2cp" podStartSLOduration=0.971534417 podStartE2EDuration="2.544212472s" totalImagesPullingTime="1.572678055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:39.543125282 +0000 UTC m=+135.120720163" watchObservedRunningTime="2026-07-28 17:24:39.544212472 +0000 UTC m=+135.121807350"
Jul 28 17:24:40.106536 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.106495    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:40.162230 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.162195    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-585b79fb69-qx685"]
Jul 28 17:24:40.165760 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.165732    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.168693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.168666    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k4rzq\""
Jul 28 17:24:40.168832 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.168816    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 17:24:40.168916 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.168900    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 17:24:40.168966 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.168905    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 17:24:40.169021 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.168993    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-148ftb0j1p7o2\""
Jul 28 17:24:40.169021 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.169010    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 17:24:40.169246 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.169228    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 17:24:40.179633 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.179584    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-585b79fb69-qx685"]
Jul 28 17:24:40.188235 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.188206    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:40.261824 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.261782    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vft7l\" (UniqueName: \"kubernetes.io/projected/b21cd6e4-0e51-4e64-b185-d608d847dd56-kube-api-access-vft7l\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.262015 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.261857    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.262015 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.261926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.262015 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.261954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-grpc-tls\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.262143 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.262017    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21cd6e4-0e51-4e64-b185-d608d847dd56-metrics-client-ca\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.262143 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.262055    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.262143 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.262079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.262241 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.262192    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-tls\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.362644 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.362529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vft7l\" (UniqueName: \"kubernetes.io/projected/b21cd6e4-0e51-4e64-b185-d608d847dd56-kube-api-access-vft7l\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.362644 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.362594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.362866 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.362650    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.362866 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.362668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-grpc-tls\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.362866 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.362691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21cd6e4-0e51-4e64-b185-d608d847dd56-metrics-client-ca\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.362866 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.362721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.362866 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.362748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.362866 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.362810    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-tls\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.363676 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.363647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21cd6e4-0e51-4e64-b185-d608d847dd56-metrics-client-ca\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.365644 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.365536    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.365644 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.365559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.365821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.365723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.365883 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.365845    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-tls\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.365937 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.365896    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-grpc-tls\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.365990 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.365948    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b21cd6e4-0e51-4e64-b185-d608d847dd56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.372641 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.372588    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vft7l\" (UniqueName: \"kubernetes.io/projected/b21cd6e4-0e51-4e64-b185-d608d847dd56-kube-api-access-vft7l\") pod \"thanos-querier-585b79fb69-qx685\" (UID: \"b21cd6e4-0e51-4e64-b185-d608d847dd56\") " pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.467470 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.467439    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:40.475107 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.475077    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:40.526955 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.526920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmlcd" event={"ID":"09324273-4fa4-4658-833d-9caa9f7eed82","Type":"ContainerStarted","Data":"f85ea9dc3d79772cb8bfb3e892224f317a206cf3f93232dc45e7766e0849fb13"}
Jul 28 17:24:40.527372 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.526988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bmlcd" event={"ID":"09324273-4fa4-4658-833d-9caa9f7eed82","Type":"ContainerStarted","Data":"6d7951311c48a9d0fa443acae25e2fdea9206ebffa329e03653c30dd23ad5318"}
Jul 28 17:24:40.553715 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.553507    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bmlcd" podStartSLOduration=2.400787901 podStartE2EDuration="3.55347752s" totalImagesPullingTime="1.066993778s" totalInitContainerRuntime="85.695841ms" isStatefulPod=true podCreationTimestamp="2026-07-28 17:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:40.550425381 +0000 UTC m=+136.128020260" watchObservedRunningTime="2026-07-28 17:24:40.55347752 +0000 UTC m=+136.131072400"
Jul 28 17:24:40.632820 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.632738    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-585b79fb69-qx685"]
Jul 28 17:24:40.636298 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:40.636270    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21cd6e4_0e51_4e64_b185_d608d847dd56.slice/crio-ec64007ba3e7ee40ed6e326d9fe65f8984ddac84e348d17279541ecc861d2010 WatchSource:0}: Error finding container ec64007ba3e7ee40ed6e326d9fe65f8984ddac84e348d17279541ecc861d2010: Status 404 returned error can't find the container with id ec64007ba3e7ee40ed6e326d9fe65f8984ddac84e348d17279541ecc861d2010
Jul 28 17:24:40.807727 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:40.807693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:41.534621 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.534580    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685" event={"ID":"b21cd6e4-0e51-4e64-b185-d608d847dd56","Type":"ContainerStarted","Data":"ec64007ba3e7ee40ed6e326d9fe65f8984ddac84e348d17279541ecc861d2010"}
Jul 28 17:24:41.787044 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.786887    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:41.853008 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.852972    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"]
Jul 28 17:24:41.856536 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.856512    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:41.859271 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.859243    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 17:24:41.859406 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.859380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gm65l\""
Jul 28 17:24:41.866081 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.866057    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"]
Jul 28 17:24:41.888142 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.888108    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:41.977875 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.977841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-59lm6\" (UID: \"6ab4b07c-f955-4621-afa1-d4dc5e5a977a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:41.978050 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:41.977884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp2mp\" (UniqueName: \"kubernetes.io/projected/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-kube-api-access-lp2mp\") pod \"monitoring-plugin-68b7fc9574-59lm6\" (UID: \"6ab4b07c-f955-4621-afa1-d4dc5e5a977a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:42.078842 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.078741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp2mp\" (UniqueName: \"kubernetes.io/projected/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-kube-api-access-lp2mp\") pod \"monitoring-plugin-68b7fc9574-59lm6\" (UID: \"6ab4b07c-f955-4621-afa1-d4dc5e5a977a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:42.078999 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.078882    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-59lm6\" (UID: \"6ab4b07c-f955-4621-afa1-d4dc5e5a977a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:42.078999 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:42.078988    2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 28 17:24:42.079109 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:42.079056    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-monitoring-plugin-cert podName:6ab4b07c-f955-4621-afa1-d4dc5e5a977a nodeName:}" failed. No retries permitted until 2026-07-28 17:24:42.579036287 +0000 UTC m=+138.156631165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-59lm6" (UID: "6ab4b07c-f955-4621-afa1-d4dc5e5a977a") : secret "monitoring-plugin-cert" not found
Jul 28 17:24:42.089250 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.089208    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp2mp\" (UniqueName: \"kubernetes.io/projected/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-kube-api-access-lp2mp\") pod \"monitoring-plugin-68b7fc9574-59lm6\" (UID: \"6ab4b07c-f955-4621-afa1-d4dc5e5a977a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:42.170162 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.170125    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:42.266474 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.266435    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:42.525632 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.525580    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:42.584251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.584215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-59lm6\" (UID: \"6ab4b07c-f955-4621-afa1-d4dc5e5a977a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:42.586915 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.586889    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ab4b07c-f955-4621-afa1-d4dc5e5a977a-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-59lm6\" (UID: \"6ab4b07c-f955-4621-afa1-d4dc5e5a977a\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:42.768267 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.768237    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:42.902227 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:42.902196    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"]
Jul 28 17:24:42.905200 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:42.905173    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab4b07c_f955_4621_afa1_d4dc5e5a977a.slice/crio-ff71bb84c42552572d738ab12c264f6f3e5ef1a76ca052a33666db96fc6df37d WatchSource:0}: Error finding container ff71bb84c42552572d738ab12c264f6f3e5ef1a76ca052a33666db96fc6df37d: Status 404 returned error can't find the container with id ff71bb84c42552572d738ab12c264f6f3e5ef1a76ca052a33666db96fc6df37d
Jul 28 17:24:43.167085 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.167044    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644dbc6566-xcvbc"]
Jul 28 17:24:43.167414 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:24:43.167373    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-644dbc6566-xcvbc" podUID="8b60ddbe-5677-4a56-9ac8-9c05573e5d33"
Jul 28 17:24:43.274668 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.274636    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:43.371550 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.371517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:43.430223 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.430139    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:24:43.435001 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.434591    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.438117 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.438043    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 17:24:43.438117 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.438087    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 17:24:43.438320 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.438043    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rtbgj\""
Jul 28 17:24:43.438821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.438796    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 17:24:43.439000 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.438956    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 17:24:43.439891 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.439695    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 17:24:43.439891 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.439781    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 17:24:43.440037 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.439923    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 17:24:43.440094 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.440064    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 17:24:43.440193 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.440176    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 17:24:43.440850 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.440833    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 17:24:43.441095 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.441078    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 17:24:43.441379 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.441362    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-54lhv434mdgn9\""
Jul 28 17:24:43.443842 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.442137    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 17:24:43.443842 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.443569    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 17:24:43.448661 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.448592    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 17:24:43.459877 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.459849    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 17:24:43.460649 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.460571    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:43.460819 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.460800    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:24:43.491640 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.491831 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.491831 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.491831 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.491831 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.491831 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.491831 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491824    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491848    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.491940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492010    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492041    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-config\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492125    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492513 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492513 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492187    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7nhw\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-kube-api-access-k7nhw\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492513 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492212    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492513 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.492513 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.492262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.548914 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.548882    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685" event={"ID":"b21cd6e4-0e51-4e64-b185-d608d847dd56","Type":"ContainerStarted","Data":"21ca3b832f6e0c67df4cb683689f7cad118ac592520e6884b12efe9e0b0e291d"}
Jul 28 17:24:43.549079 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.548947    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685" event={"ID":"b21cd6e4-0e51-4e64-b185-d608d847dd56","Type":"ContainerStarted","Data":"4d879637b65b41bcc5af592f955d7d6ff9ca3a8e46574aadc9b8a89050baa40b"}
Jul 28 17:24:43.549079 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.548973    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685" event={"ID":"b21cd6e4-0e51-4e64-b185-d608d847dd56","Type":"ContainerStarted","Data":"aa8ad6211398dcee3078b9a7ed54bbcc57a130c6deeea2fdad0bcab04768ae9d"}
Jul 28 17:24:43.553545 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.553507    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:24:43.553940 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.553905    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6" event={"ID":"6ab4b07c-f955-4621-afa1-d4dc5e5a977a","Type":"ContainerStarted","Data":"ff71bb84c42552572d738ab12c264f6f3e5ef1a76ca052a33666db96fc6df37d"}
Jul 28 17:24:43.562447 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.562419    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:24:43.593132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.592794    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.593132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.592847    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.593132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.592877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nhw\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-kube-api-access-k7nhw\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.593132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.592906    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.593132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.592933    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.593132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.592953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.593132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.592991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.593132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593018    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593644    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593767    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593830    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593856    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593883    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593935    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.593969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.594004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-config\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.594568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.594038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.595681 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.595342    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.598007 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.597327    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.598007 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.597463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.598007 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.597862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.598007 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.597884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.598007 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.597998    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.598385 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.598330    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.601319 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.601054    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.601869 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.601788    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.602231 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.602207    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.602454 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.602431    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.603035 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.602943    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.603035 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.602951    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.604773 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.604749    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.605016 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.604994    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.605085 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.605051    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-config\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.605138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.605089    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.605438 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.605394    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.605567 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.605547    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.606951 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.606929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7nhw\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-kube-api-access-k7nhw\") pod \"prometheus-k8s-0\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695162    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-trusted-ca\") pod \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") "
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695213    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-ca-trust-extracted\") pod \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") "
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695271    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-image-registry-private-configuration\") pod \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") "
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695339    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-certificates\") pod \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") "
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695364    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-bound-sa-token\") pod \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") "
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695407    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq6x5\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-kube-api-access-qq6x5\") pod \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") "
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695445    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-installation-pull-secrets\") pod \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\" (UID: \"8b60ddbe-5677-4a56-9ac8-9c05573e5d33\") "
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695735    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8b60ddbe-5677-4a56-9ac8-9c05573e5d33" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695851    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8b60ddbe-5677-4a56-9ac8-9c05573e5d33" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:24:43.696068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.695936    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8b60ddbe-5677-4a56-9ac8-9c05573e5d33" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:24:43.698527 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.698483    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-kube-api-access-qq6x5" (OuterVolumeSpecName: "kube-api-access-qq6x5") pod "8b60ddbe-5677-4a56-9ac8-9c05573e5d33" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33"). InnerVolumeSpecName "kube-api-access-qq6x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:24:43.698807 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.698715    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8b60ddbe-5677-4a56-9ac8-9c05573e5d33" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:24:43.698807 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.698766    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8b60ddbe-5677-4a56-9ac8-9c05573e5d33" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:24:43.699643 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.699590    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8b60ddbe-5677-4a56-9ac8-9c05573e5d33" (UID: "8b60ddbe-5677-4a56-9ac8-9c05573e5d33"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:24:43.760519 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.760479    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:43.796913 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.796877    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-certificates\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:24:43.796913 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.796915    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-bound-sa-token\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:24:43.797103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.796931    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq6x5\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-kube-api-access-qq6x5\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:24:43.797103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.796947    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-installation-pull-secrets\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:24:43.797103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.796961    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-trusted-ca\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:24:43.797103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.796974    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-ca-trust-extracted\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:24:43.797103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.796988    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-image-registry-private-configuration\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:24:43.937706 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:43.937653    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:24:44.261378 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:24:44.261347    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a6452c4_f964_4942_9fa5_3325908e37d3.slice/crio-69dd1309e8857a6738385c918872dcfb96479641da8e7af93af1c1bfc25d249c WatchSource:0}: Error finding container 69dd1309e8857a6738385c918872dcfb96479641da8e7af93af1c1bfc25d249c: Status 404 returned error can't find the container with id 69dd1309e8857a6738385c918872dcfb96479641da8e7af93af1c1bfc25d249c
Jul 28 17:24:44.428292 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.428258    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:44.534013 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.533920    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:44.557956 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.557918    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerStarted","Data":"69dd1309e8857a6738385c918872dcfb96479641da8e7af93af1c1bfc25d249c"}
Jul 28 17:24:44.560776 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.560742    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685" event={"ID":"b21cd6e4-0e51-4e64-b185-d608d847dd56","Type":"ContainerStarted","Data":"fb15ab4da2cee87a86ffcc89cc16cab87648ef92bcc205c876604525dc210114"}
Jul 28 17:24:44.560946 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.560812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685" event={"ID":"b21cd6e4-0e51-4e64-b185-d608d847dd56","Type":"ContainerStarted","Data":"40db754c038e4d0a1cc386d27632cbe51abf5d5107177b5001c887e1c4db2c60"}
Jul 28 17:24:44.560946 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.560849    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685" event={"ID":"b21cd6e4-0e51-4e64-b185-d608d847dd56","Type":"ContainerStarted","Data":"2da327bd8b2eb63c8db9c58ad63a0f77ca31c3cc8c297b0cecc9b9bf6e7847d8"}
Jul 28 17:24:44.561036 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.560985    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:44.562359 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.562337    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-644dbc6566-xcvbc"
Jul 28 17:24:44.562471 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.562367    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6" event={"ID":"6ab4b07c-f955-4621-afa1-d4dc5e5a977a","Type":"ContainerStarted","Data":"f47bb13972248392b62503793e45ddf037fe88c245c917d803bcfeeff821d146"}
Jul 28 17:24:44.562561 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.562548    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:44.567832 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.567796    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6"
Jul 28 17:24:44.588469 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.588414    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685" podStartSLOduration=1.648386913 podStartE2EDuration="4.588395772s" totalImagesPullingTime="2.940008859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:44.587362692 +0000 UTC m=+140.164957571" watchObservedRunningTime="2026-07-28 17:24:44.588395772 +0000 UTC m=+140.165990629"
Jul 28 17:24:44.606931 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.606875    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-59lm6" podStartSLOduration=2.204520745 podStartE2EDuration="3.606859538s" totalImagesPullingTime="1.402338793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:44.605708189 +0000 UTC m=+140.183303068" watchObservedRunningTime="2026-07-28 17:24:44.606859538 +0000 UTC m=+140.184454416"
Jul 28 17:24:44.640629 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.640586    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-644dbc6566-xcvbc"]
Jul 28 17:24:44.644217 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.644185    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-644dbc6566-xcvbc"]
Jul 28 17:24:44.706380 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.706350    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b60ddbe-5677-4a56-9ac8-9c05573e5d33-registry-tls\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:24:44.901792 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:44.901755    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b60ddbe-5677-4a56-9ac8-9c05573e5d33" path="/var/lib/kubelet/pods/8b60ddbe-5677-4a56-9ac8-9c05573e5d33/volumes"
Jul 28 17:24:45.568862 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:45.568830    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896" exitCode=0
Jul 28 17:24:45.569070 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:45.568920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerDied","Data":"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"}
Jul 28 17:24:49.589928 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:49.589819    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerStarted","Data":"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"}
Jul 28 17:24:49.590371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:49.589937    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerStarted","Data":"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"}
Jul 28 17:24:49.590371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:49.589977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerStarted","Data":"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"}
Jul 28 17:24:49.590371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:49.590018    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerStarted","Data":"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"}
Jul 28 17:24:49.590371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:49.590059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerStarted","Data":"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"}
Jul 28 17:24:49.590371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:49.590099    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerStarted","Data":"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"}
Jul 28 17:24:49.622141 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:49.622079    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.181200129 podStartE2EDuration="6.622054157s" totalImagesPullingTime="4.421151719s" totalInitContainerRuntime="19.702309ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:24:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:24:49.619558953 +0000 UTC m=+145.197153844" watchObservedRunningTime="2026-07-28 17:24:49.622054157 +0000 UTC m=+145.199649035"
Jul 28 17:24:50.575288 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:50.575254    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-585b79fb69-qx685"
Jul 28 17:24:53.432826 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:53.432784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:53.652329 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:53.652282    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:53.756373 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:53.756296    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:53.761152 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:53.761134    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:24:53.895314 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:53.895287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:53.990872 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:53.990836    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:54.091911 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:54.091833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:54.192049 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:54.192017    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:54.486349 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:54.486316    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:54.589173 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:54.589141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:54.693282 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:54.693247    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:54.859387 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:54.859359    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:55.099414 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:55.099374    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:55.306670 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:55.306564    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:56.241631 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:56.241586    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:56.521170 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:56.521098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:24:56.621707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:24:56.621674    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:00.360496 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:00.360457    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:00.435886 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:00.435857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:02.859918 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:25:02.859876    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hfjmc" podUID="dceaf718-af8e-484c-b1ef-5b7fa813199d"
Jul 28 17:25:03.645927 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:03.645895    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:25:04.120714 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:04.120683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:04.219428 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:04.219395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:05.601822 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:05.601780    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:05.707291 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:05.707255    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.530636 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:06.530574    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.635804 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:06.635772    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.697793 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:06.697765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:06.913838 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:06.913809    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:07.014028 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:07.013994    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:07.810809 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:07.810776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:25:07.813227 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:07.813206    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dceaf718-af8e-484c-b1ef-5b7fa813199d-metrics-tls\") pod \"dns-default-hfjmc\" (UID: \"dceaf718-af8e-484c-b1ef-5b7fa813199d\") " pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:25:07.850134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:07.850105    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fqthr\""
Jul 28 17:25:07.858275 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:07.858251    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:25:08.037251 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:08.037222    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hfjmc"]
Jul 28 17:25:08.039627 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:25:08.039583    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddceaf718_af8e_484c_b1ef_5b7fa813199d.slice/crio-0daccb2af53f169778c22b882bbfd3d8e52f7c1af4568b8e048fcc65cda13cc6 WatchSource:0}: Error finding container 0daccb2af53f169778c22b882bbfd3d8e52f7c1af4568b8e048fcc65cda13cc6: Status 404 returned error can't find the container with id 0daccb2af53f169778c22b882bbfd3d8e52f7c1af4568b8e048fcc65cda13cc6
Jul 28 17:25:08.664843 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:08.664803    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfjmc" event={"ID":"dceaf718-af8e-484c-b1ef-5b7fa813199d","Type":"ContainerStarted","Data":"0daccb2af53f169778c22b882bbfd3d8e52f7c1af4568b8e048fcc65cda13cc6"}
Jul 28 17:25:10.674252 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:10.674209    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfjmc" event={"ID":"dceaf718-af8e-484c-b1ef-5b7fa813199d","Type":"ContainerStarted","Data":"884fe8bb3bd9b41c1c0df6e5d3d733ef5c95d5d0c6660a1f7e86f54361700b59"}
Jul 28 17:25:10.674709 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:10.674277    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hfjmc" event={"ID":"dceaf718-af8e-484c-b1ef-5b7fa813199d","Type":"ContainerStarted","Data":"aab819817338c62bd08d6a16ff29dc9abaf09a4384eab77d8fa85928bdc6ddcd"}
Jul 28 17:25:10.674709 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:10.674378    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:25:10.695033 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:10.694974    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hfjmc" podStartSLOduration=129.901590259 podStartE2EDuration="2m11.694958074s" totalImagesPullingTime="1.793367815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:25:10.693279937 +0000 UTC m=+166.270874816" watchObservedRunningTime="2026-07-28 17:25:10.694958074 +0000 UTC m=+166.272552954"
Jul 28 17:25:11.325871 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:11.325839    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:11.467269 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:11.467230    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:12.563164 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:12.563131    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:12.658478 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:12.658447    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:16.315453 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:16.315417    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:16.433549 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:16.433517    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:20.680268 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:20.680179    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hfjmc"
Jul 28 17:25:22.724846 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:22.723887    2573 generic.go:356] "Generic (PLEG): container finished" podID="3865dd9b-7911-4b3a-bac0-d13542476989" containerID="c1a2e8b98e7557f8decf556d233d09d801da07697da50fb70f560a2cf33fd3e1" exitCode=0
Jul 28 17:25:22.724846 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:22.724023    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267" event={"ID":"3865dd9b-7911-4b3a-bac0-d13542476989","Type":"ContainerDied","Data":"c1a2e8b98e7557f8decf556d233d09d801da07697da50fb70f560a2cf33fd3e1"}
Jul 28 17:25:22.724846 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:22.724405    2573 scope.go:117] "RemoveContainer" containerID="c1a2e8b98e7557f8decf556d233d09d801da07697da50fb70f560a2cf33fd3e1"
Jul 28 17:25:23.731578 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:23.731536    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-nn267" event={"ID":"3865dd9b-7911-4b3a-bac0-d13542476989","Type":"ContainerStarted","Data":"e8a40c5f8a08e05d4009ebfacc2d13cc4230d014eaf7a5361215ae644828376f"}
Jul 28 17:25:29.822483 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:29.822447    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:29.971820 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:29.971789    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:30.203408 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:30.203370    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:30.767498 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:30.767456    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:30.867306 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:30.867271    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:39.657778 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:39.657736    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:39.765625 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:39.765588    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:43.761098 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:43.761048    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:25:43.778148 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:43.778119    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:25:43.826538 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:43.826515    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:25:53.434110 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:53.434069    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:53.548976 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:53.548944    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:53.666316 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:53.666283    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:25:53.767906 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:25:53.767822    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:02.053702 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.053659    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:26:02.054237 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.054054    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="prometheus" containerID="cri-o://142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f" gracePeriod=600
Jul 28 17:26:02.054237 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.054060    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4" gracePeriod=600
Jul 28 17:26:02.054237 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.054109    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy-web" containerID="cri-o://d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb" gracePeriod=600
Jul 28 17:26:02.054237 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.054127    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="config-reloader" containerID="cri-o://852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6" gracePeriod=600
Jul 28 17:26:02.054237 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.054115    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="thanos-sidecar" containerID="cri-o://6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5" gracePeriod=600
Jul 28 17:26:02.054237 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.054207    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy" containerID="cri-o://416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4" gracePeriod=600
Jul 28 17:26:02.306343 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.306264    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.370739 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370706    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-0\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.370942 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370747    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-serving-certs-ca-bundle\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.370942 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370781    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-metrics-client-certs\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.370942 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370824    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-trusted-ca-bundle\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.370942 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370851    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-config\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.370942 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370882    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-tls-assets\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.370942 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370912    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370956    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-db\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.370995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-metrics-client-ca\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371025    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-web-config\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371050    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-tls\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371095    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-2\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371122    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7nhw\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-kube-api-access-k7nhw\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371177    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371214    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-thanos-prometheus-http-client-file\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371262 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371251    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-grpc-tls\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371277    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-1\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371301    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-kubelet-serving-ca-bundle\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371323    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:26:02.371707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371341    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-config-out\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371367    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-kube-rbac-proxy\") pod \"4a6452c4-f964-4942-9fa5-3325908e37d3\" (UID: \"4a6452c4-f964-4942-9fa5-3325908e37d3\") "
Jul 28 17:26:02.371707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371659    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.371994 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.371846    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:26:02.372793 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.372467    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:26:02.372793 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.372564    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:26:02.372793 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.372737    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:26:02.376738 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.373811    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:26:02.376738 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.374286    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.376738 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.374686    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-kube-api-access-k7nhw" (OuterVolumeSpecName: "kube-api-access-k7nhw") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "kube-api-access-k7nhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:26:02.376738 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.375098    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.376738 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.376630    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:26:02.377254 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.376757    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.377254 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.376842    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:26:02.377254 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.376903    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.377254 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.376918    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-config" (OuterVolumeSpecName: "config") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.377254 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.377023    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:26:02.377254 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.377043    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-config-out" (OuterVolumeSpecName: "config-out") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:26:02.380397 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.380209    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.380397 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.380300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.380397 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.380350    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.391457 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.391401    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-web-config" (OuterVolumeSpecName: "web-config") pod "4a6452c4-f964-4942-9fa5-3325908e37d3" (UID: "4a6452c4-f964-4942-9fa5-3325908e37d3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:26:02.472582 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472535    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-config\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472582 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472570    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-tls-assets\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472582 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472584    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472582 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472594    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-db\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472621    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-metrics-client-ca\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472631    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-web-config\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472639    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472648    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472657    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7nhw\" (UniqueName: \"kubernetes.io/projected/4a6452c4-f964-4942-9fa5-3325908e37d3-kube-api-access-k7nhw\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472666    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472675    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472684    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-grpc-tls\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472692    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472700    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472708    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4a6452c4-f964-4942-9fa5-3325908e37d3-config-out\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472716    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-kube-rbac-proxy\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472724    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472733    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a6452c4-f964-4942-9fa5-3325908e37d3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.472882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.472741    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4a6452c4-f964-4942-9fa5-3325908e37d3-secret-metrics-client-certs\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:26:02.887311 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887278    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4" exitCode=0
Jul 28 17:26:02.887311 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887302    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4" exitCode=0
Jul 28 17:26:02.887311 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887311    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb" exitCode=0
Jul 28 17:26:02.887311 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887318    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5" exitCode=0
Jul 28 17:26:02.887311 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887323    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6" exitCode=0
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887329    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f" exitCode=0
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887360    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887363    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerDied","Data":"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"}
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887480    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerDied","Data":"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"}
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887526    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerDied","Data":"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"}
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887558    2573 scope.go:117] "RemoveContainer" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887570    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerDied","Data":"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"}
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerDied","Data":"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"}
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerDied","Data":"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"}
Jul 28 17:26:02.887821 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.887718    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4a6452c4-f964-4942-9fa5-3325908e37d3","Type":"ContainerDied","Data":"69dd1309e8857a6738385c918872dcfb96479641da8e7af93af1c1bfc25d249c"}
Jul 28 17:26:02.897128 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.897105    2573 scope.go:117] "RemoveContainer" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"
Jul 28 17:26:02.905410 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.905387    2573 scope.go:117] "RemoveContainer" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"
Jul 28 17:26:02.913544 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.913515    2573 scope.go:117] "RemoveContainer" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"
Jul 28 17:26:02.914779 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.914759    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:26:02.922026 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.922005    2573 scope.go:117] "RemoveContainer" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"
Jul 28 17:26:02.922801 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.922770    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:26:02.929733 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.929713    2573 scope.go:117] "RemoveContainer" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"
Jul 28 17:26:02.938179 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.938151    2573 scope.go:117] "RemoveContainer" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"
Jul 28 17:26:02.947054 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.947034    2573 scope.go:117] "RemoveContainer" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"
Jul 28 17:26:02.947420 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:26:02.947395    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": container with ID starting with 760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4 not found: ID does not exist" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"
Jul 28 17:26:02.947484 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.947432    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"} err="failed to get container status \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": rpc error: code = NotFound desc = could not find container \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": container with ID starting with 760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4 not found: ID does not exist"
Jul 28 17:26:02.947484 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.947468    2573 scope.go:117] "RemoveContainer" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"
Jul 28 17:26:02.947790 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:26:02.947769    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": container with ID starting with 416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4 not found: ID does not exist" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"
Jul 28 17:26:02.947885 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.947795    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"} err="failed to get container status \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": rpc error: code = NotFound desc = could not find container \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": container with ID starting with 416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4 not found: ID does not exist"
Jul 28 17:26:02.947885 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.947810    2573 scope.go:117] "RemoveContainer" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"
Jul 28 17:26:02.948048 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:26:02.948034    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": container with ID starting with d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb not found: ID does not exist" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"
Jul 28 17:26:02.948091 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.948050    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"} err="failed to get container status \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": rpc error: code = NotFound desc = could not find container \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": container with ID starting with d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb not found: ID does not exist"
Jul 28 17:26:02.948091 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.948061    2573 scope.go:117] "RemoveContainer" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"
Jul 28 17:26:02.948311 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:26:02.948291    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": container with ID starting with 6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5 not found: ID does not exist" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"
Jul 28 17:26:02.948349 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.948317    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"} err="failed to get container status \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": rpc error: code = NotFound desc = could not find container \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": container with ID starting with 6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5 not found: ID does not exist"
Jul 28 17:26:02.948349 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.948332    2573 scope.go:117] "RemoveContainer" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"
Jul 28 17:26:02.948577 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:26:02.948557    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": container with ID starting with 852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6 not found: ID does not exist" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"
Jul 28 17:26:02.948657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.948581    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"} err="failed to get container status \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": rpc error: code = NotFound desc = could not find container \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": container with ID starting with 852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6 not found: ID does not exist"
Jul 28 17:26:02.948657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.948598    2573 scope.go:117] "RemoveContainer" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"
Jul 28 17:26:02.948825 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:26:02.948808    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": container with ID starting with 142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f not found: ID does not exist" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"
Jul 28 17:26:02.948866 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.948828    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"} err="failed to get container status \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": rpc error: code = NotFound desc = could not find container \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": container with ID starting with 142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f not found: ID does not exist"
Jul 28 17:26:02.948866 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.948841    2573 scope.go:117] "RemoveContainer" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"
Jul 28 17:26:02.949060 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:26:02.949043    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": container with ID starting with 8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896 not found: ID does not exist" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"
Jul 28 17:26:02.949098 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949064    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"} err="failed to get container status \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": rpc error: code = NotFound desc = could not find container \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": container with ID starting with 8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896 not found: ID does not exist"
Jul 28 17:26:02.949098 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949078    2573 scope.go:117] "RemoveContainer" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"
Jul 28 17:26:02.949318 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949300    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"} err="failed to get container status \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": rpc error: code = NotFound desc = could not find container \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": container with ID starting with 760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4 not found: ID does not exist"
Jul 28 17:26:02.949375 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949319    2573 scope.go:117] "RemoveContainer" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"
Jul 28 17:26:02.949520 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949498    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"} err="failed to get container status \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": rpc error: code = NotFound desc = could not find container \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": container with ID starting with 416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4 not found: ID does not exist"
Jul 28 17:26:02.949559 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949520    2573 scope.go:117] "RemoveContainer" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"
Jul 28 17:26:02.949748 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949732    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"} err="failed to get container status \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": rpc error: code = NotFound desc = could not find container \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": container with ID starting with d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb not found: ID does not exist"
Jul 28 17:26:02.949801 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949749    2573 scope.go:117] "RemoveContainer" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"
Jul 28 17:26:02.949962 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949945    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"} err="failed to get container status \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": rpc error: code = NotFound desc = could not find container \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": container with ID starting with 6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5 not found: ID does not exist"
Jul 28 17:26:02.950001 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.949962    2573 scope.go:117] "RemoveContainer" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"
Jul 28 17:26:02.950136 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950119    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"} err="failed to get container status \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": rpc error: code = NotFound desc = could not find container \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": container with ID starting with 852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6 not found: ID does not exist"
Jul 28 17:26:02.950181 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950137    2573 scope.go:117] "RemoveContainer" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"
Jul 28 17:26:02.950311 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950295    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"} err="failed to get container status \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": rpc error: code = NotFound desc = could not find container \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": container with ID starting with 142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f not found: ID does not exist"
Jul 28 17:26:02.950350 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950311    2573 scope.go:117] "RemoveContainer" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"
Jul 28 17:26:02.950481 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950463    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"} err="failed to get container status \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": rpc error: code = NotFound desc = could not find container \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": container with ID starting with 8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896 not found: ID does not exist"
Jul 28 17:26:02.950520 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950481    2573 scope.go:117] "RemoveContainer" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"
Jul 28 17:26:02.950687 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950668    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"} err="failed to get container status \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": rpc error: code = NotFound desc = could not find container \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": container with ID starting with 760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4 not found: ID does not exist"
Jul 28 17:26:02.950749 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950688    2573 scope.go:117] "RemoveContainer" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"
Jul 28 17:26:02.950891 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950874    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"} err="failed to get container status \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": rpc error: code = NotFound desc = could not find container \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": container with ID starting with 416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4 not found: ID does not exist"
Jul 28 17:26:02.950937 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.950892    2573 scope.go:117] "RemoveContainer" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"
Jul 28 17:26:02.951088 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951071    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"} err="failed to get container status \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": rpc error: code = NotFound desc = could not find container \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": container with ID starting with d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb not found: ID does not exist"
Jul 28 17:26:02.951138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951089    2573 scope.go:117] "RemoveContainer" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"
Jul 28 17:26:02.951273 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951257    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"} err="failed to get container status \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": rpc error: code = NotFound desc = could not find container \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": container with ID starting with 6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5 not found: ID does not exist"
Jul 28 17:26:02.951314 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951272    2573 scope.go:117] "RemoveContainer" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"
Jul 28 17:26:02.951488 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951471    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"} err="failed to get container status \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": rpc error: code = NotFound desc = could not find container \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": container with ID starting with 852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6 not found: ID does not exist"
Jul 28 17:26:02.951530 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951489    2573 scope.go:117] "RemoveContainer" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"
Jul 28 17:26:02.951709 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951689    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"} err="failed to get container status \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": rpc error: code = NotFound desc = could not find container \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": container with ID starting with 142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f not found: ID does not exist"
Jul 28 17:26:02.951762 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951710    2573 scope.go:117] "RemoveContainer" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"
Jul 28 17:26:02.951901 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951884    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"} err="failed to get container status \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": rpc error: code = NotFound desc = could not find container \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": container with ID starting with 8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896 not found: ID does not exist"
Jul 28 17:26:02.951945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.951901    2573 scope.go:117] "RemoveContainer" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"
Jul 28 17:26:02.952084 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.952069    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"} err="failed to get container status \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": rpc error: code = NotFound desc = could not find container \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": container with ID starting with 760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4 not found: ID does not exist"
Jul 28 17:26:02.952132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.952086    2573 scope.go:117] "RemoveContainer" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"
Jul 28 17:26:02.952284 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.952266    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"} err="failed to get container status \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": rpc error: code = NotFound desc = could not find container \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": container with ID starting with 416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4 not found: ID does not exist"
Jul 28 17:26:02.952325 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.952284    2573 scope.go:117] "RemoveContainer" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"
Jul 28 17:26:02.952487 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.952469    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"} err="failed to get container status \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": rpc error: code = NotFound desc = could not find container \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": container with ID starting with d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb not found: ID does not exist"
Jul 28 17:26:02.952538 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.952488    2573 scope.go:117] "RemoveContainer" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"
Jul 28 17:26:02.952777 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.952748    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"} err="failed to get container status \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": rpc error: code = NotFound desc = could not find container \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": container with ID starting with 6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5 not found: ID does not exist"
Jul 28 17:26:02.952777 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.952773    2573 scope.go:117] "RemoveContainer" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"
Jul 28 17:26:02.953059 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.953041    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"} err="failed to get container status \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": rpc error: code = NotFound desc = could not find container \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": container with ID starting with 852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6 not found: ID does not exist"
Jul 28 17:26:02.953059 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.953058    2573 scope.go:117] "RemoveContainer" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"
Jul 28 17:26:02.953454 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.953427    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"} err="failed to get container status \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": rpc error: code = NotFound desc = could not find container \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": container with ID starting with 142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f not found: ID does not exist"
Jul 28 17:26:02.953635 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.953456    2573 scope.go:117] "RemoveContainer" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"
Jul 28 17:26:02.953894 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.953764    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"} err="failed to get container status \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": rpc error: code = NotFound desc = could not find container \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": container with ID starting with 8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896 not found: ID does not exist"
Jul 28 17:26:02.953894 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.953817    2573 scope.go:117] "RemoveContainer" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"
Jul 28 17:26:02.954171 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.954111    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"} err="failed to get container status \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": rpc error: code = NotFound desc = could not find container \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": container with ID starting with 760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4 not found: ID does not exist"
Jul 28 17:26:02.954243 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.954174    2573 scope.go:117] "RemoveContainer" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"
Jul 28 17:26:02.954965 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.954941    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"} err="failed to get container status \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": rpc error: code = NotFound desc = could not find container \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": container with ID starting with 416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4 not found: ID does not exist"
Jul 28 17:26:02.954965 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.954965    2573 scope.go:117] "RemoveContainer" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"
Jul 28 17:26:02.955239 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955220    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"} err="failed to get container status \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": rpc error: code = NotFound desc = could not find container \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": container with ID starting with d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb not found: ID does not exist"
Jul 28 17:26:02.955300 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955242    2573 scope.go:117] "RemoveContainer" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"
Jul 28 17:26:02.955300 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955257    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:26:02.955460 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955445    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"} err="failed to get container status \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": rpc error: code = NotFound desc = could not find container \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": container with ID starting with 6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5 not found: ID does not exist"
Jul 28 17:26:02.955504 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955460    2573 scope.go:117] "RemoveContainer" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"
Jul 28 17:26:02.955580 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955564    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy-thanos"
Jul 28 17:26:02.955657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955583    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy-thanos"
Jul 28 17:26:02.955657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955596    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="config-reloader"
Jul 28 17:26:02.955657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955602    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="config-reloader"
Jul 28 17:26:02.955657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955623    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy-web"
Jul 28 17:26:02.955657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955629    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy-web"
Jul 28 17:26:02.955657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955640    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="prometheus"
Jul 28 17:26:02.955657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955645    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="prometheus"
Jul 28 17:26:02.955657 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955652    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955661    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955672    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="thanos-sidecar"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955678    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="thanos-sidecar"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955686    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="init-config-reloader"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955691    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="init-config-reloader"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955753    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="config-reloader"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955762    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy-thanos"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955686    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"} err="failed to get container status \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": rpc error: code = NotFound desc = could not find container \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": container with ID starting with 852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6 not found: ID does not exist"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955778    2573 scope.go:117] "RemoveContainer" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955769    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="prometheus"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955821    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="thanos-sidecar"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955830    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy-web"
Jul 28 17:26:02.955902 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.955840    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" containerName="kube-rbac-proxy"
Jul 28 17:26:02.956375 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.956000    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"} err="failed to get container status \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": rpc error: code = NotFound desc = could not find container \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": container with ID starting with 142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f not found: ID does not exist"
Jul 28 17:26:02.956375 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.956019    2573 scope.go:117] "RemoveContainer" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"
Jul 28 17:26:02.956375 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.956279    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"} err="failed to get container status \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": rpc error: code = NotFound desc = could not find container \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": container with ID starting with 8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896 not found: ID does not exist"
Jul 28 17:26:02.956375 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.956304    2573 scope.go:117] "RemoveContainer" containerID="760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"
Jul 28 17:26:02.956556 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.956536    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4"} err="failed to get container status \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": rpc error: code = NotFound desc = could not find container \"760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4\": container with ID starting with 760a478b976583367664249fd6b3f0699664bed73009fe8e17694958882c42e4 not found: ID does not exist"
Jul 28 17:26:02.956592 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.956558    2573 scope.go:117] "RemoveContainer" containerID="416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"
Jul 28 17:26:02.956816 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.956786    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4"} err="failed to get container status \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": rpc error: code = NotFound desc = could not find container \"416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4\": container with ID starting with 416d9d4f72367e000b98468327a1ab6edbce0bb9fbff7cebc94d1ea420b670f4 not found: ID does not exist"
Jul 28 17:26:02.956889 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.956818    2573 scope.go:117] "RemoveContainer" containerID="d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"
Jul 28 17:26:02.957060 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957044    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb"} err="failed to get container status \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": rpc error: code = NotFound desc = could not find container \"d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb\": container with ID starting with d9527a9690972d6bd8c6ccf318c01ea6bd7b9cbe842975e8671b81f96052c3bb not found: ID does not exist"
Jul 28 17:26:02.957120 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957061    2573 scope.go:117] "RemoveContainer" containerID="6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"
Jul 28 17:26:02.957291 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957273    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5"} err="failed to get container status \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": rpc error: code = NotFound desc = could not find container \"6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5\": container with ID starting with 6be6094f263a653edd544714571eabc0643a4abdc1800d0377b90083b90ad3f5 not found: ID does not exist"
Jul 28 17:26:02.957355 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957292    2573 scope.go:117] "RemoveContainer" containerID="852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"
Jul 28 17:26:02.957509 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957485    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6"} err="failed to get container status \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": rpc error: code = NotFound desc = could not find container \"852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6\": container with ID starting with 852bc52beb94ef2a0a9eecfc8aa1cdff67d842b8a02b5a1a65dd0feb901f0cc6 not found: ID does not exist"
Jul 28 17:26:02.957509 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957504    2573 scope.go:117] "RemoveContainer" containerID="142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"
Jul 28 17:26:02.957734 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957717    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f"} err="failed to get container status \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": rpc error: code = NotFound desc = could not find container \"142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f\": container with ID starting with 142ef74bbd44c79fb520d55048d47ee88ebdee7fbc76a07637345cb169557f6f not found: ID does not exist"
Jul 28 17:26:02.957818 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957736    2573 scope.go:117] "RemoveContainer" containerID="8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"
Jul 28 17:26:02.957961 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.957944    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896"} err="failed to get container status \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": rpc error: code = NotFound desc = could not find container \"8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896\": container with ID starting with 8a577056d5b810eb3da1b26a234de596be6489976b4f68c50dc2fda5c5f95896 not found: ID does not exist"
Jul 28 17:26:02.960424 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.960405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.963376 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.963342    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 17:26:02.965823 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.965800    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 17:26:02.965945 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.965915    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 17:26:02.966484 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.966461    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 17:26:02.966579 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.966458    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 17:26:02.966579 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.966506    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 17:26:02.966808 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.966788    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 17:26:02.967357 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.967340    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 17:26:02.967445 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.967367    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rtbgj\""
Jul 28 17:26:02.967445 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.967372    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 17:26:02.967662 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.967644    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 17:26:02.967735 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.967720    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 17:26:02.969018 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.968997    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 17:26:02.969188 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.969046    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 17:26:02.969271 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.969255    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-54lhv434mdgn9\""
Jul 28 17:26:02.969673 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.969658    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 17:26:02.975260 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pxrq\" (UniqueName: \"kubernetes.io/projected/eedb243a-c118-4bdf-9ae0-7c71131dcff7-kube-api-access-5pxrq\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975396 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975396 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975310    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975396 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-web-config\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975619    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-config\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eedb243a-c118-4bdf-9ae0-7c71131dcff7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975750    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975795    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.975899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.975811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eedb243a-c118-4bdf-9ae0-7c71131dcff7-config-out\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:02.976775 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.976756    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 17:26:02.984101 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:02.984068    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:26:03.076671 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.076594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.077103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.076687    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-config\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.077103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.076715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.077103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.076741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.077103 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.076892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eedb243a-c118-4bdf-9ae0-7c71131dcff7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.077332 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.077332 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.077332 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077482    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eedb243a-c118-4bdf-9ae0-7c71131dcff7-config-out\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pxrq\" (UniqueName: \"kubernetes.io/projected/eedb243a-c118-4bdf-9ae0-7c71131dcff7-kube-api-access-5pxrq\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-web-config\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077772    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077892    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.078138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.077971    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.080401 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.079330    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.080401 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.080117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.081511 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.080881    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.081511 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.080898    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.081511 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.081281    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.081511 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.081297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-config\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.081511 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.081441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eedb243a-c118-4bdf-9ae0-7c71131dcff7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.081511 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.081470    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.082487 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.082463    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.082743 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.082717    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eedb243a-c118-4bdf-9ae0-7c71131dcff7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.083068 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.083041    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.083165 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.083052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-web-config\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.083165 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.083146    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.083294 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.083278    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.083826 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.083809    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eedb243a-c118-4bdf-9ae0-7c71131dcff7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.084087 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.084072    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eedb243a-c118-4bdf-9ae0-7c71131dcff7-config-out\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.088871 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.088840    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pxrq\" (UniqueName: \"kubernetes.io/projected/eedb243a-c118-4bdf-9ae0-7c71131dcff7-kube-api-access-5pxrq\") pod \"prometheus-k8s-0\" (UID: \"eedb243a-c118-4bdf-9ae0-7c71131dcff7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.271280 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.271182    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:03.424544 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.424517    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 17:26:03.426409 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:26:03.426376    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeedb243a_c118_4bdf_9ae0_7c71131dcff7.slice/crio-de19661e2fcf53b677f78aff817304add9c7343ccbb6b31b175ff88d82435b32 WatchSource:0}: Error finding container de19661e2fcf53b677f78aff817304add9c7343ccbb6b31b175ff88d82435b32: Status 404 returned error can't find the container with id de19661e2fcf53b677f78aff817304add9c7343ccbb6b31b175ff88d82435b32
Jul 28 17:26:03.893140 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.893112    2573 generic.go:356] "Generic (PLEG): container finished" podID="eedb243a-c118-4bdf-9ae0-7c71131dcff7" containerID="e5708b4421e68c9d35ce548ed9ba3991c2582f0ab14621aab8c6d3f5438f7779" exitCode=0
Jul 28 17:26:03.893320 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.893203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eedb243a-c118-4bdf-9ae0-7c71131dcff7","Type":"ContainerDied","Data":"e5708b4421e68c9d35ce548ed9ba3991c2582f0ab14621aab8c6d3f5438f7779"}
Jul 28 17:26:03.893320 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:03.893287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eedb243a-c118-4bdf-9ae0-7c71131dcff7","Type":"ContainerStarted","Data":"de19661e2fcf53b677f78aff817304add9c7343ccbb6b31b175ff88d82435b32"}
Jul 28 17:26:04.900350 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.900318    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a6452c4-f964-4942-9fa5-3325908e37d3" path="/var/lib/kubelet/pods/4a6452c4-f964-4942-9fa5-3325908e37d3/volumes"
Jul 28 17:26:04.902009 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.901971    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eedb243a-c118-4bdf-9ae0-7c71131dcff7","Type":"ContainerStarted","Data":"31cd6804999fe53879af5178a555be730bdf29880af5ec5adbaa9cfbf7c97465"}
Jul 28 17:26:04.902139 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.902034    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eedb243a-c118-4bdf-9ae0-7c71131dcff7","Type":"ContainerStarted","Data":"482e522fa0b7ddabb7da6d774d50f68e02b387ac8273e587eb9809656a52b1f5"}
Jul 28 17:26:04.902139 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.902065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eedb243a-c118-4bdf-9ae0-7c71131dcff7","Type":"ContainerStarted","Data":"89376b58c7be163e5692514a9d10aebae9926d552c0e2008531445ff8bfc7792"}
Jul 28 17:26:04.902139 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.902093    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eedb243a-c118-4bdf-9ae0-7c71131dcff7","Type":"ContainerStarted","Data":"9726105db7c3f66af7500ec5708cd59fa3df8c2e1219391c18bbefdc306faeb3"}
Jul 28 17:26:04.902139 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.902129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eedb243a-c118-4bdf-9ae0-7c71131dcff7","Type":"ContainerStarted","Data":"c6df34fd75a2f4732e9a64b2c11d00ca12915aa6ea569278933670239e414d58"}
Jul 28 17:26:04.902318 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.902153    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eedb243a-c118-4bdf-9ae0-7c71131dcff7","Type":"ContainerStarted","Data":"f61d593a0782019af7ced4f8ac7fe9dda03c83790587cb4a6d2005e2893a3fc0"}
Jul 28 17:26:04.909543 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.909515    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:04.998410 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:04.998350    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.977388298 podStartE2EDuration="2.998328416s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.940118ms" isStatefulPod=false podCreationTimestamp="2026-07-28 17:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:26:04.997704594 +0000 UTC m=+220.575299472" watchObservedRunningTime="2026-07-28 17:26:04.998328416 +0000 UTC m=+220.575923296"
Jul 28 17:26:05.044073 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:05.044038    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:05.368553 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:05.368521    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:05.427591 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:05.427556    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:08.272185 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:08.272146    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:26:09.676398 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:09.676365    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:09.776345 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:09.776312    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:26:29.086132 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:26:29.086098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:03.271912 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:03.271819    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:27:03.288338 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:03.288309    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:27:04.145372 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:04.145295    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 17:27:10.530870 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:10.530833    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:10.631484 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:10.631420    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:10.939744 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:10.939707    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:11.078014 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:11.077975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:11.179922 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:11.179888    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:24.816322 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:24.816290    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 17:27:34.064144 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:34.064109    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:34.154671 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:34.154592    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:39.905920 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:39.905887    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:40.274870 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:40.274778    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:40.505339 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:40.505302    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:40.691728 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:40.691693    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:40.963589 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:40.963499    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:41.381348 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:41.381313    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:41.485067 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:41.485030    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:41.690913 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:41.690834    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:41.787007 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:41.786975    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:41.885990 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:41.885940    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:42.118889 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:42.118857    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:42.265950 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:42.265913    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:27:42.361098 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:27:42.361064    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:14.403520 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:28:14.403486    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:15.976037 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:28:15.976000    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:16.056179 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:28:16.056141    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:43.077235 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:28:43.077160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:28:44.792697 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:28:44.792665    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:00.065809 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:29:00.065770    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:00.213783 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:29:00.213755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:06.370108 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:29:06.370062    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:06.631426 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:29:06.631342    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:06.904605 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:29:06.904527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:07.061560 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:29:07.061531    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:07.578532 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:29:07.578501    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:29:07.823185 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:29:07.823147    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:22.802892 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:22.802855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:26.713181 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:26.713139    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:26.826572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:26.826536    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:26.927667 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:26.927634    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:27.091689 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:27.091584    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:27.716136 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:27.716103    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:27.814560 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:27.814524    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:31.926101 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:31.926058    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:43.114022 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.113985    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:43.212653 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.212594    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:30:43.665789 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.665756    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-hb9p4"]
Jul 28 17:30:43.669199 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.669178    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-hb9p4"
Jul 28 17:30:43.671827 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.671806    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 28 17:30:43.671963 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.671885    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 17:30:43.671963 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.671910    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-r9pdw\""
Jul 28 17:30:43.672562 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.672545    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 17:30:43.678446 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.678424    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-hb9p4"]
Jul 28 17:30:43.799195 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.799152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e57dd2-02f4-42b6-9186-c5106fbccfbe-model-cache\") pod \"s3-init-hb9p4\" (UID: \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\") " pod="kserve/s3-init-hb9p4"
Jul 28 17:30:43.799375 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.799201    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r766\" (UniqueName: \"kubernetes.io/projected/96e57dd2-02f4-42b6-9186-c5106fbccfbe-kube-api-access-8r766\") pod \"s3-init-hb9p4\" (UID: \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\") " pod="kserve/s3-init-hb9p4"
Jul 28 17:30:43.899716 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.899673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e57dd2-02f4-42b6-9186-c5106fbccfbe-model-cache\") pod \"s3-init-hb9p4\" (UID: \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\") " pod="kserve/s3-init-hb9p4"
Jul 28 17:30:43.899716 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.899720    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r766\" (UniqueName: \"kubernetes.io/projected/96e57dd2-02f4-42b6-9186-c5106fbccfbe-kube-api-access-8r766\") pod \"s3-init-hb9p4\" (UID: \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\") " pod="kserve/s3-init-hb9p4"
Jul 28 17:30:43.900123 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.900106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e57dd2-02f4-42b6-9186-c5106fbccfbe-model-cache\") pod \"s3-init-hb9p4\" (UID: \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\") " pod="kserve/s3-init-hb9p4"
Jul 28 17:30:43.908272 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.908242    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r766\" (UniqueName: \"kubernetes.io/projected/96e57dd2-02f4-42b6-9186-c5106fbccfbe-kube-api-access-8r766\") pod \"s3-init-hb9p4\" (UID: \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\") " pod="kserve/s3-init-hb9p4"
Jul 28 17:30:43.984368 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:43.984271    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-hb9p4"
Jul 28 17:30:44.123485 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:44.123453    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-hb9p4"]
Jul 28 17:30:44.127827 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:30:44.127796    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96e57dd2_02f4_42b6_9186_c5106fbccfbe.slice/crio-636c7d5af53ac73aa34456ea6bd4d3950ca6ad4533036fbfb1f207b67e520475 WatchSource:0}: Error finding container 636c7d5af53ac73aa34456ea6bd4d3950ca6ad4533036fbfb1f207b67e520475: Status 404 returned error can't find the container with id 636c7d5af53ac73aa34456ea6bd4d3950ca6ad4533036fbfb1f207b67e520475
Jul 28 17:30:44.129660 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:44.129642    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:30:44.970456 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:44.970416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hb9p4" event={"ID":"96e57dd2-02f4-42b6-9186-c5106fbccfbe","Type":"ContainerStarted","Data":"636c7d5af53ac73aa34456ea6bd4d3950ca6ad4533036fbfb1f207b67e520475"}
Jul 28 17:30:47.986707 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:30:47.986671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hb9p4" event={"ID":"96e57dd2-02f4-42b6-9186-c5106fbccfbe","Type":"ContainerStarted","Data":"0ee79d7e034f8813809f0cdc07f9acb1109d5258ee052264dd6587fc153d205a"}
Jul 28 17:31:15.095513 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:31:15.095478    2573 generic.go:356] "Generic (PLEG): container finished" podID="96e57dd2-02f4-42b6-9186-c5106fbccfbe" containerID="0ee79d7e034f8813809f0cdc07f9acb1109d5258ee052264dd6587fc153d205a" exitCode=0
Jul 28 17:31:15.095972 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:31:15.095551    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hb9p4" event={"ID":"96e57dd2-02f4-42b6-9186-c5106fbccfbe","Type":"ContainerDied","Data":"0ee79d7e034f8813809f0cdc07f9acb1109d5258ee052264dd6587fc153d205a"}
Jul 28 17:31:20.120186 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:31:20.120138    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hb9p4" event={"ID":"96e57dd2-02f4-42b6-9186-c5106fbccfbe","Type":"ContainerStarted","Data":"f8d10f7107802b21b3b74c1ff3ab4197c86d431203f1b31a43fe06b27b9a2614"}
Jul 28 17:31:20.146443 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:31:20.146387    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-hb9p4" podStartSLOduration=2.5317608910000002 podStartE2EDuration="37.146366525s" totalImagesPullingTime="8.082304268s" totalInitContainerRuntime="26.532301366s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:30:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:31:20.145047885 +0000 UTC m=+535.722642763" watchObservedRunningTime="2026-07-28 17:31:20.146366525 +0000 UTC m=+535.723961402"
Jul 28 17:31:29.015965 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:31:29.015928    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:13.022134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:13.022098    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:25.383500 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:25.383467    2573 generic.go:356] "Generic (PLEG): container finished" podID="96e57dd2-02f4-42b6-9186-c5106fbccfbe" containerID="f8d10f7107802b21b3b74c1ff3ab4197c86d431203f1b31a43fe06b27b9a2614" exitCode=0
Jul 28 17:32:25.384029 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:25.383543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hb9p4" event={"ID":"96e57dd2-02f4-42b6-9186-c5106fbccfbe","Type":"ContainerDied","Data":"f8d10f7107802b21b3b74c1ff3ab4197c86d431203f1b31a43fe06b27b9a2614"}
Jul 28 17:32:26.517275 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:26.517247    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-hb9p4"
Jul 28 17:32:26.676089 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:26.675997    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e57dd2-02f4-42b6-9186-c5106fbccfbe-model-cache\") pod \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\" (UID: \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\") "
Jul 28 17:32:26.676089 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:26.676062    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r766\" (UniqueName: \"kubernetes.io/projected/96e57dd2-02f4-42b6-9186-c5106fbccfbe-kube-api-access-8r766\") pod \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\" (UID: \"96e57dd2-02f4-42b6-9186-c5106fbccfbe\") "
Jul 28 17:32:26.678295 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:26.678259    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e57dd2-02f4-42b6-9186-c5106fbccfbe-kube-api-access-8r766" (OuterVolumeSpecName: "kube-api-access-8r766") pod "96e57dd2-02f4-42b6-9186-c5106fbccfbe" (UID: "96e57dd2-02f4-42b6-9186-c5106fbccfbe"). InnerVolumeSpecName "kube-api-access-8r766". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:32:26.695619 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:26.695566    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e57dd2-02f4-42b6-9186-c5106fbccfbe-model-cache" (OuterVolumeSpecName: "model-cache") pod "96e57dd2-02f4-42b6-9186-c5106fbccfbe" (UID: "96e57dd2-02f4-42b6-9186-c5106fbccfbe"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:32:26.777118 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:26.777078    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r766\" (UniqueName: \"kubernetes.io/projected/96e57dd2-02f4-42b6-9186-c5106fbccfbe-kube-api-access-8r766\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:32:26.777118 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:26.777107    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96e57dd2-02f4-42b6-9186-c5106fbccfbe-model-cache\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:32:27.393140 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:27.393106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-hb9p4" event={"ID":"96e57dd2-02f4-42b6-9186-c5106fbccfbe","Type":"ContainerDied","Data":"636c7d5af53ac73aa34456ea6bd4d3950ca6ad4533036fbfb1f207b67e520475"}
Jul 28 17:32:27.393140 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:27.393144    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="636c7d5af53ac73aa34456ea6bd4d3950ca6ad4533036fbfb1f207b67e520475"
Jul 28 17:32:27.393405 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:27.393155    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-hb9p4"
Jul 28 17:32:27.810844 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:27.810765    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:27.905084 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:27.905052    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:29.164645 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:29.164597    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:29.307213 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:29.307183    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:38.908675 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:38.908640    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:39.294072 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.293991    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:39.319257 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.319157    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"]
Jul 28 17:32:39.319572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.319553    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e57dd2-02f4-42b6-9186-c5106fbccfbe" containerName="download-hf-model"
Jul 28 17:32:39.319693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.319576    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e57dd2-02f4-42b6-9186-c5106fbccfbe" containerName="download-hf-model"
Jul 28 17:32:39.319693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.319591    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e57dd2-02f4-42b6-9186-c5106fbccfbe" containerName="s3-init"
Jul 28 17:32:39.319693 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.319601    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e57dd2-02f4-42b6-9186-c5106fbccfbe" containerName="s3-init"
Jul 28 17:32:39.319853 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.319711    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e57dd2-02f4-42b6-9186-c5106fbccfbe" containerName="s3-init"
Jul 28 17:32:39.322901 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.322880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.326294 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.326266    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 17:32:39.327077 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.327062    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-7f5hv\""
Jul 28 17:32:39.327372 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.327354    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 17:32:39.327458 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.327355    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Jul 28 17:32:39.327665 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.327650    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 17:32:39.328134 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.328120    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 17:32:39.328348 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.328334    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Jul 28 17:32:39.340954 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.340925    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"]
Jul 28 17:32:39.420319 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.420289    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:39.442218 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.442186    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"]
Jul 28 17:32:39.445670 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.445649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.448017 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.447997    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Jul 28 17:32:39.448119 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.448019    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Jul 28 17:32:39.456672 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.456645    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"]
Jul 28 17:32:39.483325 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.483287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.483482 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.483400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8w2q\" (UniqueName: \"kubernetes.io/projected/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-api-access-l8w2q\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.483482 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.483448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.483482 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.483475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5f1542d-ab00-4a28-9f7b-323565f72c04-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.483581 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.483495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.522538 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.522504    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:39.584787 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.584689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.584787 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.584738    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8w2q\" (UniqueName: \"kubernetes.io/projected/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-api-access-l8w2q\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.584992 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.584797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmr5h\" (UniqueName: \"kubernetes.io/projected/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-api-access-bmr5h\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.584992 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.584833    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.584992 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.584862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77a92b8f-69fe-4718-bfeb-bf97aa539127-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.584992 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.584894    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5f1542d-ab00-4a28-9f7b-323565f72c04-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.584992 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.584922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.584992 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.584959    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.585278 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.585006    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.585278 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:32:39.585127    2573 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 28 17:32:39.585278 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.585137    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.585278 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:32:39.585199    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls podName:d5f1542d-ab00-4a28-9f7b-323565f72c04 nodeName:}" failed. No retries permitted until 2026-07-28 17:32:40.085178191 +0000 UTC m=+615.662773063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls") pod "isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" (UID: "d5f1542d-ab00-4a28-9f7b-323565f72c04") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 28 17:32:39.585461 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.585297    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5f1542d-ab00-4a28-9f7b-323565f72c04-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.585504 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.585480    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.585592 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.585572    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.589142 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.589118    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:39.595461 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.595433    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8w2q\" (UniqueName: \"kubernetes.io/projected/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-api-access-l8w2q\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:39.675520 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.675488    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:39.685598 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.685560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmr5h\" (UniqueName: \"kubernetes.io/projected/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-api-access-bmr5h\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.685598 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.685601    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77a92b8f-69fe-4718-bfeb-bf97aa539127-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.685840 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.685735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.685840 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.685770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.685840 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.685825    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.686013 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:32:39.685960    2573 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found
Jul 28 17:32:39.686067 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:32:39.686055    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls podName:77a92b8f-69fe-4718-bfeb-bf97aa539127 nodeName:}" failed. No retries permitted until 2026-07-28 17:32:40.186032441 +0000 UTC m=+615.763627297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-tbg9w" (UID: "77a92b8f-69fe-4718-bfeb-bf97aa539127") : secret "isvc-xgboost-graph-predictor-serving-cert" not found
Jul 28 17:32:39.686190 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.686173    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77a92b8f-69fe-4718-bfeb-bf97aa539127-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.686588 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.686564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.686674 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.686564    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.697138 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.697104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmr5h\" (UniqueName: \"kubernetes.io/projected/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-api-access-bmr5h\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:39.718229 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.718186    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"]
Jul 28 17:32:39.722904 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.722876    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.725137 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.725108    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Jul 28 17:32:39.725137 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.725125    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Jul 28 17:32:39.734163 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.734134    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"]
Jul 28 17:32:39.887365 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.887326    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.887572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.887377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.887572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.887446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxqrw\" (UniqueName: \"kubernetes.io/projected/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-api-access-wxqrw\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.887572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.887489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.887572 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.887508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.988801 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.988763    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.988801 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.988800    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.989354 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.988837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.989354 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.988862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.989354 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.988909    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxqrw\" (UniqueName: \"kubernetes.io/projected/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-api-access-wxqrw\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.989354 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.989295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.989594 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.989574    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.989703 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.989687    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.991349 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.991330    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.996994 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.996967    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxqrw\" (UniqueName: \"kubernetes.io/projected/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-api-access-wxqrw\") pod \"isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:39.999368 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:39.999339    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:40.033884 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.033845    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:32:40.090785 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.090748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:40.093843 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.093805    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:40.102105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.102026    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:40.171086 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.171062    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"]
Jul 28 17:32:40.173029 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:32:40.173004    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe21f4b_5b00_46b1_8e15_b4659e23cc84.slice/crio-560ce37aa05629819dbb068ffdd143206ad3e5c55dc4b86139d81ec838158a4a WatchSource:0}: Error finding container 560ce37aa05629819dbb068ffdd143206ad3e5c55dc4b86139d81ec838158a4a: Status 404 returned error can't find the container with id 560ce37aa05629819dbb068ffdd143206ad3e5c55dc4b86139d81ec838158a4a
Jul 28 17:32:40.191995 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.191972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:40.192133 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:32:40.192115    2573 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-predictor-serving-cert: secret "isvc-xgboost-graph-predictor-serving-cert" not found
Jul 28 17:32:40.192193 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:32:40.192177    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls podName:77a92b8f-69fe-4718-bfeb-bf97aa539127 nodeName:}" failed. No retries permitted until 2026-07-28 17:32:41.192162755 +0000 UTC m=+616.769757612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls") pod "isvc-xgboost-graph-predictor-555fc69d56-tbg9w" (UID: "77a92b8f-69fe-4718-bfeb-bf97aa539127") : secret "isvc-xgboost-graph-predictor-serving-cert" not found
Jul 28 17:32:40.202703 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.202675    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:40.234173 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.234142    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:32:40.302123 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.302092    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:32:40.376655 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.376488    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"]
Jul 28 17:32:40.379243 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:32:40.379209    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f1542d_ab00_4a28_9f7b_323565f72c04.slice/crio-75140ca09ad5c8f4492732d0399910f01d151eeacacd19d7966a80a5b80f087a WatchSource:0}: Error finding container 75140ca09ad5c8f4492732d0399910f01d151eeacacd19d7966a80a5b80f087a: Status 404 returned error can't find the container with id 75140ca09ad5c8f4492732d0399910f01d151eeacacd19d7966a80a5b80f087a
Jul 28 17:32:40.452626 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.452571    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" event={"ID":"cfe21f4b-5b00-46b1-8e15-b4659e23cc84","Type":"ContainerStarted","Data":"87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808"}
Jul 28 17:32:40.452836 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.452720    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" event={"ID":"cfe21f4b-5b00-46b1-8e15-b4659e23cc84","Type":"ContainerStarted","Data":"560ce37aa05629819dbb068ffdd143206ad3e5c55dc4b86139d81ec838158a4a"}
Jul 28 17:32:40.454327 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.454293    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" event={"ID":"d5f1542d-ab00-4a28-9f7b-323565f72c04","Type":"ContainerStarted","Data":"1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec"}
Jul 28 17:32:40.454467 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:40.454362    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" event={"ID":"d5f1542d-ab00-4a28-9f7b-323565f72c04","Type":"ContainerStarted","Data":"75140ca09ad5c8f4492732d0399910f01d151eeacacd19d7966a80a5b80f087a"}
Jul 28 17:32:41.202040 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:41.201989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:41.204444 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:41.204414    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-tbg9w\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:41.256355 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:41.256316    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:32:41.392472 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:41.392433    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"]
Jul 28 17:32:41.394661 ip-10-0-142-249 kubenswrapper[2573]: W0728 17:32:41.394632    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a92b8f_69fe_4718_bfeb_bf97aa539127.slice/crio-9bf5452562dbfcfb0451bb4c42fb49e2e4ccaf1d47292900323d1fb3cd2f9d8d WatchSource:0}: Error finding container 9bf5452562dbfcfb0451bb4c42fb49e2e4ccaf1d47292900323d1fb3cd2f9d8d: Status 404 returned error can't find the container with id 9bf5452562dbfcfb0451bb4c42fb49e2e4ccaf1d47292900323d1fb3cd2f9d8d
Jul 28 17:32:41.460553 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:41.460461    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" event={"ID":"77a92b8f-69fe-4718-bfeb-bf97aa539127","Type":"ContainerStarted","Data":"f3df44392c3f56b54c43d2b2d3cdaec0601d6ec3134c3814973801087202e371"}
Jul 28 17:32:41.460553 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:41.460533    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" event={"ID":"77a92b8f-69fe-4718-bfeb-bf97aa539127","Type":"ContainerStarted","Data":"9bf5452562dbfcfb0451bb4c42fb49e2e4ccaf1d47292900323d1fb3cd2f9d8d"}
Jul 28 17:32:44.474826 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:44.474795    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerID="87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808" exitCode=0
Jul 28 17:32:44.475245 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:44.474875    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" event={"ID":"cfe21f4b-5b00-46b1-8e15-b4659e23cc84","Type":"ContainerDied","Data":"87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808"}
Jul 28 17:32:44.476581 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:44.476507    2573 generic.go:356] "Generic (PLEG): container finished" podID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerID="1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec" exitCode=0
Jul 28 17:32:44.476581 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:44.476541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" event={"ID":"d5f1542d-ab00-4a28-9f7b-323565f72c04","Type":"ContainerDied","Data":"1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec"}
Jul 28 17:32:46.519336 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:46.519289    2573 generic.go:356] "Generic (PLEG): container finished" podID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerID="f3df44392c3f56b54c43d2b2d3cdaec0601d6ec3134c3814973801087202e371" exitCode=0
Jul 28 17:32:46.519833 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:32:46.519370    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" event={"ID":"77a92b8f-69fe-4718-bfeb-bf97aa539127","Type":"ContainerDied","Data":"f3df44392c3f56b54c43d2b2d3cdaec0601d6ec3134c3814973801087202e371"}
Jul 28 17:33:13.684101 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:13.684057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" event={"ID":"cfe21f4b-5b00-46b1-8e15-b4659e23cc84","Type":"ContainerStarted","Data":"3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4"}
Jul 28 17:33:13.686533 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:13.686497    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" event={"ID":"77a92b8f-69fe-4718-bfeb-bf97aa539127","Type":"ContainerStarted","Data":"267cc2552bead64590e155d7788b41d82c28199d7e9849598d1814a26f048998"}
Jul 28 17:33:13.691881 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:13.691844    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" event={"ID":"d5f1542d-ab00-4a28-9f7b-323565f72c04","Type":"ContainerStarted","Data":"6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297"}
Jul 28 17:33:16.710015 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.709975    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" event={"ID":"cfe21f4b-5b00-46b1-8e15-b4659e23cc84","Type":"ContainerStarted","Data":"71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc"}
Jul 28 17:33:16.710471 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.710070    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:33:16.710471 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.710122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:33:16.711890 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.711848    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:33:16.712309 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.712285    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" event={"ID":"77a92b8f-69fe-4718-bfeb-bf97aa539127","Type":"ContainerStarted","Data":"7da32adebae1e224140ba01478ccc257b447fd4a14d3e1a06c513a5dc7aa3c64"}
Jul 28 17:33:16.712416 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.712344    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:33:16.712416 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.712377    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:33:16.713644 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.713606    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 28 17:33:16.714456 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.714435    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" event={"ID":"d5f1542d-ab00-4a28-9f7b-323565f72c04","Type":"ContainerStarted","Data":"1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a"}
Jul 28 17:33:16.714605 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.714569    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:33:16.733308 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.733266    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podStartSLOduration=2.501198683 podStartE2EDuration="37.733251153s" totalImagesPullingTime="31.210744444s" totalInitContainerRuntime="4.021308026s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:32:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:33:16.732973642 +0000 UTC m=+652.310568519" watchObservedRunningTime="2026-07-28 17:33:16.733251153 +0000 UTC m=+652.310846031"
Jul 28 17:33:16.758700 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.758648    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podStartSLOduration=4.498910862 podStartE2EDuration="37.758629892s" totalImagesPullingTime="29.215683165s" totalInitContainerRuntime="4.044035865s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:32:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:33:16.7573307 +0000 UTC m=+652.334925579" watchObservedRunningTime="2026-07-28 17:33:16.758629892 +0000 UTC m=+652.336224766"
Jul 28 17:33:16.779042 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:16.778990    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podStartSLOduration=2.991523695 podStartE2EDuration="37.778974707s" totalImagesPullingTime="31.212675992s" totalInitContainerRuntime="3.57477502s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:32:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:33:16.777644254 +0000 UTC m=+652.355239127" watchObservedRunningTime="2026-07-28 17:33:16.778974707 +0000 UTC m=+652.356569584"
Jul 28 17:33:17.719397 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:17.719353    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 28 17:33:17.719847 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:17.719353    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:33:17.719847 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:17.719505    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:33:17.720735 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:17.720708    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:33:18.724074 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:18.724036    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:33:22.724516 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:22.724481    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:33:22.724898 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:22.724592    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:33:22.725080 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:22.725051    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:33:22.725144 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:22.725078    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 28 17:33:23.729093 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:23.729064    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:33:23.729579 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:23.729553    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:33:27.091703 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:27.091664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:33:32.725502 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:32.725458    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 28 17:33:32.725928 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:32.725458    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:33:33.730510 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:33.730469    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:33:42.725599 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:42.725561    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:33:42.726109 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:42.725562    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 28 17:33:43.729593 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:43.729554    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:33:52.725233 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:52.725188    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 28 17:33:52.725233 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:52.725188    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:33:53.730458 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:53.730415    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:33:59.108280 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:33:59.108245    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:00.520510 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:00.520477    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:02.725242 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:02.725200    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:34:02.725666 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:02.725199    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 28 17:34:03.729774 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:03.729732    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:34:12.725772 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:12.725734    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused"
Jul 28 17:34:12.726258 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:12.725744    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:34:13.308958 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:13.308926    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:13.462553 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:13.462496    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:13.542174 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:13.542140    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:13.619381 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:13.619349    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:13.717739 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:13.717708    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:13.730532 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:13.730498    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:34:14.037022 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:14.036941    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:22.725642 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:22.725527    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused"
Jul 28 17:34:22.726176 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:22.725774    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:34:23.730307 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:23.730263    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:34:28.895888 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:28.895831    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.22:8080: connect: connection refused"
Jul 28 17:34:31.895559 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:31.895521    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:34:37.939878 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:37.939843    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:37.998278 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:37.998251    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:34:38.900553 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:34:38.900523    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:35:09.021703 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:09.021664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:09.364807 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:09.364774    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:13.527768 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:13.527739    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:13.741947 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:13.741912    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:23.181979 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.181948    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:23.233756 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.233721    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"]
Jul 28 17:35:23.233991 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.233970    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container" containerID="cri-o://3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4" gracePeriod=30
Jul 28 17:35:23.234059 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.234010    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kube-rbac-proxy" containerID="cri-o://71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc" gracePeriod=30
Jul 28 17:35:23.289569 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.289534    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:23.304334 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.304300    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"]
Jul 28 17:35:23.304588 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.304553    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container" containerID="cri-o://6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297" gracePeriod=30
Jul 28 17:35:23.304752 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.304600    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kube-rbac-proxy" containerID="cri-o://1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a" gracePeriod=30
Jul 28 17:35:23.349647 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.349591    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"]
Jul 28 17:35:23.349887 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.349860    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container" containerID="cri-o://267cc2552bead64590e155d7788b41d82c28199d7e9849598d1814a26f048998" gracePeriod=30
Jul 28 17:35:23.349984 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.349925    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kube-rbac-proxy" containerID="cri-o://7da32adebae1e224140ba01478ccc257b447fd4a14d3e1a06c513a5dc7aa3c64" gracePeriod=30
Jul 28 17:35:23.373210 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.373178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:23.450388 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.450300    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:23.548139 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.548077    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:23.725061 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:23.724956    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.22:8643/healthz\": dial tcp 10.132.0.22:8643: connect: connection refused"
Jul 28 17:35:24.193365 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:24.193332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:35:24.256499 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:24.256466    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerID="71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc" exitCode=2
Jul 28 17:35:24.256715 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:24.256538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" event={"ID":"cfe21f4b-5b00-46b1-8e15-b4659e23cc84","Type":"ContainerDied","Data":"71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc"}
Jul 28 17:35:24.258489 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:24.258465    2573 generic.go:356] "Generic (PLEG): container finished" podID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerID="7da32adebae1e224140ba01478ccc257b447fd4a14d3e1a06c513a5dc7aa3c64" exitCode=2
Jul 28 17:35:24.258632 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:24.258544    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" event={"ID":"77a92b8f-69fe-4718-bfeb-bf97aa539127","Type":"ContainerDied","Data":"7da32adebae1e224140ba01478ccc257b447fd4a14d3e1a06c513a5dc7aa3c64"}
Jul 28 17:35:24.260493 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:24.260471    2573 generic.go:356] "Generic (PLEG): container finished" podID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerID="1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a" exitCode=2
Jul 28 17:35:24.260590 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:24.260543    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" event={"ID":"d5f1542d-ab00-4a28-9f7b-323565f72c04","Type":"ContainerDied","Data":"1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a"}
Jul 28 17:35:27.274938 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.274900    2573 generic.go:356] "Generic (PLEG): container finished" podID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerID="267cc2552bead64590e155d7788b41d82c28199d7e9849598d1814a26f048998" exitCode=0
Jul 28 17:35:27.275317 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.274949    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" event={"ID":"77a92b8f-69fe-4718-bfeb-bf97aa539127","Type":"ContainerDied","Data":"267cc2552bead64590e155d7788b41d82c28199d7e9849598d1814a26f048998"}
Jul 28 17:35:27.309994 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.309967    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:35:27.380463 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.380423    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmr5h\" (UniqueName: \"kubernetes.io/projected/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-api-access-bmr5h\") pod \"77a92b8f-69fe-4718-bfeb-bf97aa539127\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") "
Jul 28 17:35:27.380463 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.380472    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-cabundle-cert\") pod \"77a92b8f-69fe-4718-bfeb-bf97aa539127\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") "
Jul 28 17:35:27.380733 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.380549    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-rbac-proxy-sar-config\") pod \"77a92b8f-69fe-4718-bfeb-bf97aa539127\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") "
Jul 28 17:35:27.380733 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.380570    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls\") pod \"77a92b8f-69fe-4718-bfeb-bf97aa539127\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") "
Jul 28 17:35:27.380733 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.380635    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77a92b8f-69fe-4718-bfeb-bf97aa539127-kserve-provision-location\") pod \"77a92b8f-69fe-4718-bfeb-bf97aa539127\" (UID: \"77a92b8f-69fe-4718-bfeb-bf97aa539127\") "
Jul 28 17:35:27.380990 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.380962    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "77a92b8f-69fe-4718-bfeb-bf97aa539127" (UID: "77a92b8f-69fe-4718-bfeb-bf97aa539127"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:35:27.381065 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.380961    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "77a92b8f-69fe-4718-bfeb-bf97aa539127" (UID: "77a92b8f-69fe-4718-bfeb-bf97aa539127"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:35:27.381065 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.381004    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77a92b8f-69fe-4718-bfeb-bf97aa539127-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "77a92b8f-69fe-4718-bfeb-bf97aa539127" (UID: "77a92b8f-69fe-4718-bfeb-bf97aa539127"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:35:27.382995 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.382969    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "77a92b8f-69fe-4718-bfeb-bf97aa539127" (UID: "77a92b8f-69fe-4718-bfeb-bf97aa539127"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:35:27.383069 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.382993    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-api-access-bmr5h" (OuterVolumeSpecName: "kube-api-access-bmr5h") pod "77a92b8f-69fe-4718-bfeb-bf97aa539127" (UID: "77a92b8f-69fe-4718-bfeb-bf97aa539127"). InnerVolumeSpecName "kube-api-access-bmr5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:35:27.481830 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.481737    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:27.481830 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.481775    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/77a92b8f-69fe-4718-bfeb-bf97aa539127-proxy-tls\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:27.481830 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.481785    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77a92b8f-69fe-4718-bfeb-bf97aa539127-kserve-provision-location\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:27.481830 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.481797    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmr5h\" (UniqueName: \"kubernetes.io/projected/77a92b8f-69fe-4718-bfeb-bf97aa539127-kube-api-access-bmr5h\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:27.481830 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.481806    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/77a92b8f-69fe-4718-bfeb-bf97aa539127-cabundle-cert\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:27.720064 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:27.720016    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused"
Jul 28 17:35:28.282105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.282059    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w" event={"ID":"77a92b8f-69fe-4718-bfeb-bf97aa539127","Type":"ContainerDied","Data":"9bf5452562dbfcfb0451bb4c42fb49e2e4ccaf1d47292900323d1fb3cd2f9d8d"}
Jul 28 17:35:28.282105 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.282099    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"
Jul 28 17:35:28.282626 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.282147    2573 scope.go:117] "RemoveContainer" containerID="7da32adebae1e224140ba01478ccc257b447fd4a14d3e1a06c513a5dc7aa3c64"
Jul 28 17:35:28.309088 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.309055    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"]
Jul 28 17:35:28.313083 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.313054    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-tbg9w"]
Jul 28 17:35:28.344960 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.344936    2573 scope.go:117] "RemoveContainer" containerID="267cc2552bead64590e155d7788b41d82c28199d7e9849598d1814a26f048998"
Jul 28 17:35:28.352843 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.352818    2573 scope.go:117] "RemoveContainer" containerID="f3df44392c3f56b54c43d2b2d3cdaec0601d6ec3134c3814973801087202e371"
Jul 28 17:35:28.527450 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.527420    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:35:28.590066 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.590033    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kserve-provision-location\") pod \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") "
Jul 28 17:35:28.590261 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.590110    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-proxy-tls\") pod \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") "
Jul 28 17:35:28.590261 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.590156    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxqrw\" (UniqueName: \"kubernetes.io/projected/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-api-access-wxqrw\") pod \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") "
Jul 28 17:35:28.590261 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.590180    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-rbac-proxy-sar-config\") pod \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") "
Jul 28 17:35:28.590261 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.590199    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-cabundle-cert\") pod \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\" (UID: \"cfe21f4b-5b00-46b1-8e15-b4659e23cc84\") "
Jul 28 17:35:28.590484 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.590430    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "cfe21f4b-5b00-46b1-8e15-b4659e23cc84" (UID: "cfe21f4b-5b00-46b1-8e15-b4659e23cc84"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:35:28.590665 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.590639    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "cfe21f4b-5b00-46b1-8e15-b4659e23cc84" (UID: "cfe21f4b-5b00-46b1-8e15-b4659e23cc84"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:35:28.590757 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.590673    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "cfe21f4b-5b00-46b1-8e15-b4659e23cc84" (UID: "cfe21f4b-5b00-46b1-8e15-b4659e23cc84"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:35:28.593625 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.593591    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cfe21f4b-5b00-46b1-8e15-b4659e23cc84" (UID: "cfe21f4b-5b00-46b1-8e15-b4659e23cc84"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:35:28.593731 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.593662    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-api-access-wxqrw" (OuterVolumeSpecName: "kube-api-access-wxqrw") pod "cfe21f4b-5b00-46b1-8e15-b4659e23cc84" (UID: "cfe21f4b-5b00-46b1-8e15-b4659e23cc84"). InnerVolumeSpecName "kube-api-access-wxqrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:35:28.655700 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.655671    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:35:28.691097 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691063    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-cabundle-cert\") pod \"d5f1542d-ab00-4a28-9f7b-323565f72c04\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") "
Jul 28 17:35:28.691269 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691127    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8w2q\" (UniqueName: \"kubernetes.io/projected/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-api-access-l8w2q\") pod \"d5f1542d-ab00-4a28-9f7b-323565f72c04\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") "
Jul 28 17:35:28.691269 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691150    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls\") pod \"d5f1542d-ab00-4a28-9f7b-323565f72c04\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") "
Jul 28 17:35:28.691269 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691209    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5f1542d-ab00-4a28-9f7b-323565f72c04-kserve-provision-location\") pod \"d5f1542d-ab00-4a28-9f7b-323565f72c04\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") "
Jul 28 17:35:28.691269 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691241    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-rbac-proxy-sar-config\") pod \"d5f1542d-ab00-4a28-9f7b-323565f72c04\" (UID: \"d5f1542d-ab00-4a28-9f7b-323565f72c04\") "
Jul 28 17:35:28.691482 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691427    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxqrw\" (UniqueName: \"kubernetes.io/projected/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-api-access-wxqrw\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.691482 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691447    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.691482 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691462    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-cabundle-cert\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.691482 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691475    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-kserve-provision-location\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.691684 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691488    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cfe21f4b-5b00-46b1-8e15-b4659e23cc84-proxy-tls\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.691684 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691557    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "d5f1542d-ab00-4a28-9f7b-323565f72c04" (UID: "d5f1542d-ab00-4a28-9f7b-323565f72c04"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:35:28.691684 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691572    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5f1542d-ab00-4a28-9f7b-323565f72c04-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "d5f1542d-ab00-4a28-9f7b-323565f72c04" (UID: "d5f1542d-ab00-4a28-9f7b-323565f72c04"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:35:28.691789 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.691681    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d5f1542d-ab00-4a28-9f7b-323565f72c04" (UID: "d5f1542d-ab00-4a28-9f7b-323565f72c04"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:35:28.693317 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.693294    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d5f1542d-ab00-4a28-9f7b-323565f72c04" (UID: "d5f1542d-ab00-4a28-9f7b-323565f72c04"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:35:28.693399 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.693351    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-api-access-l8w2q" (OuterVolumeSpecName: "kube-api-access-l8w2q") pod "d5f1542d-ab00-4a28-9f7b-323565f72c04" (UID: "d5f1542d-ab00-4a28-9f7b-323565f72c04"). InnerVolumeSpecName "kube-api-access-l8w2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:35:28.792899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.792796    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8w2q\" (UniqueName: \"kubernetes.io/projected/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-api-access-l8w2q\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.792899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.792832    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d5f1542d-ab00-4a28-9f7b-323565f72c04-proxy-tls\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.792899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.792846    2573 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d5f1542d-ab00-4a28-9f7b-323565f72c04-kserve-provision-location\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.792899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.792857    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-kube-rbac-proxy-sar-config\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.792899 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.792869    2573 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/d5f1542d-ab00-4a28-9f7b-323565f72c04-cabundle-cert\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 17:35:28.899692 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:28.899659    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" path="/var/lib/kubelet/pods/77a92b8f-69fe-4718-bfeb-bf97aa539127/volumes"
Jul 28 17:35:29.293165 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.293132    2573 generic.go:356] "Generic (PLEG): container finished" podID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerID="3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4" exitCode=0
Jul 28 17:35:29.293599 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.293199    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"
Jul 28 17:35:29.293599 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.293214    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" event={"ID":"cfe21f4b-5b00-46b1-8e15-b4659e23cc84","Type":"ContainerDied","Data":"3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4"}
Jul 28 17:35:29.293599 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.293304    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl" event={"ID":"cfe21f4b-5b00-46b1-8e15-b4659e23cc84","Type":"ContainerDied","Data":"560ce37aa05629819dbb068ffdd143206ad3e5c55dc4b86139d81ec838158a4a"}
Jul 28 17:35:29.293599 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.293332    2573 scope.go:117] "RemoveContainer" containerID="71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc"
Jul 28 17:35:29.296809 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.296784    2573 generic.go:356] "Generic (PLEG): container finished" podID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerID="6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297" exitCode=0
Jul 28 17:35:29.296925 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.296848    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"
Jul 28 17:35:29.296925 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.296858    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" event={"ID":"d5f1542d-ab00-4a28-9f7b-323565f72c04","Type":"ContainerDied","Data":"6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297"}
Jul 28 17:35:29.296925 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.296919    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg" event={"ID":"d5f1542d-ab00-4a28-9f7b-323565f72c04","Type":"ContainerDied","Data":"75140ca09ad5c8f4492732d0399910f01d151eeacacd19d7966a80a5b80f087a"}
Jul 28 17:35:29.302710 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.302685    2573 scope.go:117] "RemoveContainer" containerID="3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4"
Jul 28 17:35:29.310547 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.310527    2573 scope.go:117] "RemoveContainer" containerID="87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808"
Jul 28 17:35:29.313044 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.313020    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"]
Jul 28 17:35:29.319412 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.319390    2573 scope.go:117] "RemoveContainer" containerID="71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc"
Jul 28 17:35:29.319769 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:35:29.319744    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc\": container with ID starting with 71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc not found: ID does not exist" containerID="71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc"
Jul 28 17:35:29.319872 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.319777    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc"} err="failed to get container status \"71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc\": rpc error: code = NotFound desc = could not find container \"71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc\": container with ID starting with 71c3df74cad46f233b3a3677ad3dfc6b00504372e9585f894d4ad2e338b1a0fc not found: ID does not exist"
Jul 28 17:35:29.319872 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.319798    2573 scope.go:117] "RemoveContainer" containerID="3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4"
Jul 28 17:35:29.320125 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:35:29.320102    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4\": container with ID starting with 3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4 not found: ID does not exist" containerID="3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4"
Jul 28 17:35:29.320176 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.320133    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4"} err="failed to get container status \"3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4\": rpc error: code = NotFound desc = could not find container \"3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4\": container with ID starting with 3a2c97186bd03258a211d97ec6deb5cb6aa4b380dd49569c16e83bd51d65d7b4 not found: ID does not exist"
Jul 28 17:35:29.320176 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.320154    2573 scope.go:117] "RemoveContainer" containerID="87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808"
Jul 28 17:35:29.320413 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:35:29.320398    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808\": container with ID starting with 87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808 not found: ID does not exist" containerID="87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808"
Jul 28 17:35:29.320453 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.320416    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808"} err="failed to get container status \"87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808\": rpc error: code = NotFound desc = could not find container \"87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808\": container with ID starting with 87ae8ae6d87a23467dee6da84e1edcf80b36e0e05b159125ac44e9505c2a6808 not found: ID does not exist"
Jul 28 17:35:29.320453 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.320429    2573 scope.go:117] "RemoveContainer" containerID="1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a"
Jul 28 17:35:29.320576 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.320557    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bc9545b47-6bbpl"]
Jul 28 17:35:29.328910 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.328891    2573 scope.go:117] "RemoveContainer" containerID="6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297"
Jul 28 17:35:29.335882 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.335853    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"]
Jul 28 17:35:29.337466 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.337449    2573 scope.go:117] "RemoveContainer" containerID="1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec"
Jul 28 17:35:29.341242 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.341217    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84c58bd689-6fbfg"]
Jul 28 17:35:29.345976 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.345953    2573 scope.go:117] "RemoveContainer" containerID="1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a"
Jul 28 17:35:29.346324 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:35:29.346305    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a\": container with ID starting with 1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a not found: ID does not exist" containerID="1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a"
Jul 28 17:35:29.346417 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.346331    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a"} err="failed to get container status \"1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a\": rpc error: code = NotFound desc = could not find container \"1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a\": container with ID starting with 1fd6279635f195aebb9abf4912af8e6e81df21a69fb91247dfc63d806a6e575a not found: ID does not exist"
Jul 28 17:35:29.346417 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.346350    2573 scope.go:117] "RemoveContainer" containerID="6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297"
Jul 28 17:35:29.346645 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:35:29.346622    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297\": container with ID starting with 6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297 not found: ID does not exist" containerID="6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297"
Jul 28 17:35:29.346702 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.346653    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297"} err="failed to get container status \"6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297\": rpc error: code = NotFound desc = could not find container \"6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297\": container with ID starting with 6e74ae21594250301df6d1462b56835a47fc0b97316dd78c24e86ef518175297 not found: ID does not exist"
Jul 28 17:35:29.346702 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.346671    2573 scope.go:117] "RemoveContainer" containerID="1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec"
Jul 28 17:35:29.346898 ip-10-0-142-249 kubenswrapper[2573]: E0728 17:35:29.346882    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec\": container with ID starting with 1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec not found: ID does not exist" containerID="1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec"
Jul 28 17:35:29.346942 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:29.346904    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec"} err="failed to get container status \"1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec\": rpc error: code = NotFound desc = could not find container \"1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec\": container with ID starting with 1a2382bdcbeac948bea40ae0dbc7e7de9b0fd8ab0dd887ed8013810b4024a6ec not found: ID does not exist"
Jul 28 17:35:30.900320 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:30.900280    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" path="/var/lib/kubelet/pods/cfe21f4b-5b00-46b1-8e15-b4659e23cc84/volumes"
Jul 28 17:35:30.901009 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:35:30.900988    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" path="/var/lib/kubelet/pods/d5f1542d-ab00-4a28-9f7b-323565f72c04/volumes"
Jul 28 17:36:23.354386 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:36:23.354329    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:36:23.511359 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:36:23.511319    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:38:02.064718 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:38:02.064683    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:40:20.124633 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:40:20.124527    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:41:47.199371 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:41:47.199287    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:28.130540 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:43:28.130465    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:28.266568 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:43:28.266535    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:28.377830 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:43:28.377793    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:28.499665 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:43:28.499543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:28.604072 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:43:28.604043    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:28.699209 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:43:28.699178    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:43:28.817771 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:43:28.817691    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:28.365669 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:28.365635    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:28.568851 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:28.568800    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:38.030101 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:38.030061    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:38.275274 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:38.275240    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:38.419769 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:38.419713    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:38.561962 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:38.561929    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:38.685765 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:38.685664    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:38.987829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:38.987701    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:39.212127 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:39.212095    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:39.360507 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:39.360459    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:39.473783 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:39.473723    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:39.574956 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:39.574919    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:44:57.251019 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:44:57.250905    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:18.446904 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:18.446869    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:18.522690 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:18.522625    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:38.389745 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:38.389690    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:40.569393 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:40.569332    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:52.348964 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:52.348882    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:52.494298 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:52.494257    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:52.597811 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:52.597777    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:52.700858 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:52.700755    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:52.858709 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:52.858676    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:45:52.957245 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:45:52.957160    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:46:52.575880 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:46:52.575847    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:46:52.717427 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:46:52.717396    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:48:51.790695 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:48:51.790658    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:52:17.482727 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:52:17.482635    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:53.534288 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:53:53.534227    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:53.617906 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:53:53.617874    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:53.740574 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:53:53.740543    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:53.835355 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:53:53.835278    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:53.901842 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:53:53.901810    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:53:54.145811 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:53:54.145784    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:53.717423 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:54:53.717386    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:54:54.345127 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:54:54.345074    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:03.881909 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:03.881873    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:04.027219 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:04.027189    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:04.142946 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:04.142855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:04.257506 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:04.257469    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:04.358005 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:04.357965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:04.458424 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:04.458336    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:07.203829 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:07.203792    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:07.372139 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:07.372106    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:07.493248 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:07.493164    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:07.592236 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:07.592208    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:07.664522 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:07.664482    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:55:08.082043 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:55:08.082009    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:04.088550 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:56:04.088502    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:04.255135 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:56:04.255104    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:12.062166 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:56:12.062123    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:17.635761 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:56:17.635724    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:17.954026 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:56:17.953933    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:36.927008 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:56:36.926968    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:56:37.003267 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:56:37.003234    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 17:57:52.438354 ip-10-0-142-249 kubenswrapper[2573]: I0728 17:57:52.438322    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:04:18.746016 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:04:18.745930    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:04:20.594430 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:04:20.594395    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:05:02.312424 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:05:02.312392    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:06:11.325218 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:06:11.325180    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:32.620517 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:32.620479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:36.644891 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:36.644855    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:36.816078 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:36.816045    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:36.928785 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:36.928687    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:38.352007 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.351970    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p4wgg/must-gather-m59tv"]
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352311    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352323    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352331    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kube-rbac-proxy"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352337    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kube-rbac-proxy"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352347    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="storage-initializer"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352353    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="storage-initializer"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352359    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352365    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352372    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kube-rbac-proxy"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352378    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kube-rbac-proxy"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352387    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="storage-initializer"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352391    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="storage-initializer"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352399    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352404    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352412    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kube-rbac-proxy"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352417    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kube-rbac-proxy"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352427    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="storage-initializer"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352432    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="storage-initializer"
Jul 28 18:12:38.352475 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352480    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kserve-container"
Jul 28 18:12:38.353048 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352489    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kube-rbac-proxy"
Jul 28 18:12:38.353048 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352497    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kube-rbac-proxy"
Jul 28 18:12:38.353048 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352503    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a92b8f-69fe-4718-bfeb-bf97aa539127" containerName="kserve-container"
Jul 28 18:12:38.353048 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352508    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5f1542d-ab00-4a28-9f7b-323565f72c04" containerName="kube-rbac-proxy"
Jul 28 18:12:38.353048 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.352515    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe21f4b-5b00-46b1-8e15-b4659e23cc84" containerName="kserve-container"
Jul 28 18:12:38.355586 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.355564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:12:38.357995 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.357975    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4wgg\"/\"kube-root-ca.crt\""
Jul 28 18:12:38.358120 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.357975    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4wgg\"/\"openshift-service-ca.crt\""
Jul 28 18:12:38.358775 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.358759    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p4wgg\"/\"default-dockercfg-tc7ts\""
Jul 28 18:12:38.366702 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.366670    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:38.372705 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.372671    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4wgg/must-gather-m59tv"]
Jul 28 18:12:38.399990 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.399947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-must-gather-output\") pod \"must-gather-m59tv\" (UID: \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\") " pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:12:38.400170 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.400006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh7j8\" (UniqueName: \"kubernetes.io/projected/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-kube-api-access-dh7j8\") pod \"must-gather-m59tv\" (UID: \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\") " pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:12:38.461575 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.461532    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:12:38.500860 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.500811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-must-gather-output\") pod \"must-gather-m59tv\" (UID: \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\") " pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:12:38.501014 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.500895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7j8\" (UniqueName: \"kubernetes.io/projected/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-kube-api-access-dh7j8\") pod \"must-gather-m59tv\" (UID: \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\") " pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:12:38.501238 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.501216    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-must-gather-output\") pod \"must-gather-m59tv\" (UID: \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\") " pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:12:38.512418 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.512386    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh7j8\" (UniqueName: \"kubernetes.io/projected/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-kube-api-access-dh7j8\") pod \"must-gather-m59tv\" (UID: \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\") " pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:12:38.677560 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.677473    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:12:38.819231 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.819191    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4wgg/must-gather-m59tv"]
Jul 28 18:12:38.822317 ip-10-0-142-249 kubenswrapper[2573]: W0728 18:12:38.822280    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3de8f7e_8122_45fa_bb7e_a9726dbece3d.slice/crio-062405cefdd85654bcf0fb141a0fbe037db9c369df3d9d07b565a9ab66b68924 WatchSource:0}: Error finding container 062405cefdd85654bcf0fb141a0fbe037db9c369df3d9d07b565a9ab66b68924: Status 404 returned error can't find the container with id 062405cefdd85654bcf0fb141a0fbe037db9c369df3d9d07b565a9ab66b68924
Jul 28 18:12:38.824150 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.824128    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 18:12:38.985186 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:38.985095    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4wgg/must-gather-m59tv" event={"ID":"e3de8f7e-8122-45fa-bb7e-a9726dbece3d","Type":"ContainerStarted","Data":"062405cefdd85654bcf0fb141a0fbe037db9c369df3d9d07b565a9ab66b68924"}
Jul 28 18:12:46.021325 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:46.021280    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4wgg/must-gather-m59tv" event={"ID":"e3de8f7e-8122-45fa-bb7e-a9726dbece3d","Type":"ContainerStarted","Data":"8a6a050c26172fbae541211ce47e3dc893f0a703247174ed33159b18269998fb"}
Jul 28 18:12:46.021325 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:46.021332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4wgg/must-gather-m59tv" event={"ID":"e3de8f7e-8122-45fa-bb7e-a9726dbece3d","Type":"ContainerStarted","Data":"0c569d39da81c82f8bbaf187160a8f0569952d6518e02046ce6c03d403f02a99"}
Jul 28 18:12:46.042177 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:12:46.042117    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p4wgg/must-gather-m59tv" podStartSLOduration=1.858479773 podStartE2EDuration="8.042094482s" totalImagesPullingTime="6.183614709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 18:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:12:46.040789397 +0000 UTC m=+3021.618384274" watchObservedRunningTime="2026-07-28 18:12:46.042094482 +0000 UTC m=+3021.619689360"
Jul 28 18:13:09.129523 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:09.129482    2573 generic.go:356] "Generic (PLEG): container finished" podID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerID="0c569d39da81c82f8bbaf187160a8f0569952d6518e02046ce6c03d403f02a99" exitCode=0
Jul 28 18:13:09.129523 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:09.129515    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4wgg/must-gather-m59tv" event={"ID":"e3de8f7e-8122-45fa-bb7e-a9726dbece3d","Type":"ContainerDied","Data":"0c569d39da81c82f8bbaf187160a8f0569952d6518e02046ce6c03d403f02a99"}
Jul 28 18:13:09.130061 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:09.129897    2573 scope.go:117] "RemoveContainer" containerID="0c569d39da81c82f8bbaf187160a8f0569952d6518e02046ce6c03d403f02a99"
Jul 28 18:13:09.517969 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:09.517882    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p4wgg_must-gather-m59tv_e3de8f7e-8122-45fa-bb7e-a9726dbece3d/gather/0.log"
Jul 28 18:13:10.074079 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:10.074019    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:10.189960 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:10.189922    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:10.270422 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:10.270389    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:12.941038 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:12.941005    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rzmd7_4b791044-ec01-4361-a7af-94b280ecf848/global-pull-secret-syncer/0.log"
Jul 28 18:13:13.101416 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:13.101372    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log"
Jul 28 18:13:13.324125 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:13.324037    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-249.ec2.internal_146ec1ace48114f74bcbf562afadcc12/haproxy/0.log"
Jul 28 18:13:14.987736 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:14.987698    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-p4wgg/must-gather-m59tv"]
Jul 28 18:13:14.988194 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:14.987889    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-p4wgg/must-gather-m59tv" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerName="copy" containerID="cri-o://8a6a050c26172fbae541211ce47e3dc893f0a703247174ed33159b18269998fb" gracePeriod=2
Jul 28 18:13:15.002479 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.002452    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-p4wgg/must-gather-m59tv"]
Jul 28 18:13:15.009413 ip-10-0-142-249 kubenswrapper[2573]: E0728 18:13:15.009379    2573 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-p4wgg\"/\"must-gather-m59tv\": pods \"must-gather-m59tv\" not found" pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:13:15.155977 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.155948    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p4wgg_must-gather-m59tv_e3de8f7e-8122-45fa-bb7e-a9726dbece3d/copy/0.log"
Jul 28 18:13:15.156334 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.156294    2573 generic.go:356] "Generic (PLEG): container finished" podID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerID="8a6a050c26172fbae541211ce47e3dc893f0a703247174ed33159b18269998fb" exitCode=143
Jul 28 18:13:15.222327 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.222307    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p4wgg_must-gather-m59tv_e3de8f7e-8122-45fa-bb7e-a9726dbece3d/copy/0.log"
Jul 28 18:13:15.224294 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.224271    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:13:15.226741 ip-10-0-142-249 kubenswrapper[2573]: E0728 18:13:15.226715    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-m59tv\" is forbidden: User \"system:node:ip-10-0-142-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-p4wgg\": no relationship found between node 'ip-10-0-142-249.ec2.internal' and this object" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:13:15.334034 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.333938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-must-gather-output\") pod \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\" (UID: \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\") "
Jul 28 18:13:15.334034 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.334016    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh7j8\" (UniqueName: \"kubernetes.io/projected/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-kube-api-access-dh7j8\") pod \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\" (UID: \"e3de8f7e-8122-45fa-bb7e-a9726dbece3d\") "
Jul 28 18:13:15.335516 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.335481    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "e3de8f7e-8122-45fa-bb7e-a9726dbece3d" (UID: "e3de8f7e-8122-45fa-bb7e-a9726dbece3d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 18:13:15.336248 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.336225    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-kube-api-access-dh7j8" (OuterVolumeSpecName: "kube-api-access-dh7j8") pod "e3de8f7e-8122-45fa-bb7e-a9726dbece3d" (UID: "e3de8f7e-8122-45fa-bb7e-a9726dbece3d"). InnerVolumeSpecName "kube-api-access-dh7j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 18:13:15.435199 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.435155    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh7j8\" (UniqueName: \"kubernetes.io/projected/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-kube-api-access-dh7j8\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 18:13:15.435199 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:15.435188    2573 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e3de8f7e-8122-45fa-bb7e-a9726dbece3d-must-gather-output\") on node \"ip-10-0-142-249.ec2.internal\" DevicePath \"\""
Jul 28 18:13:16.161624 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:16.161595    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p4wgg_must-gather-m59tv_e3de8f7e-8122-45fa-bb7e-a9726dbece3d/copy/0.log"
Jul 28 18:13:16.162043 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:16.162026    2573 scope.go:117] "RemoveContainer" containerID="8a6a050c26172fbae541211ce47e3dc893f0a703247174ed33159b18269998fb"
Jul 28 18:13:16.162139 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:16.162047    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:13:16.164850 ip-10-0-142-249 kubenswrapper[2573]: E0728 18:13:16.164821    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-m59tv\" is forbidden: User \"system:node:ip-10-0-142-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-p4wgg\": no relationship found between node 'ip-10-0-142-249.ec2.internal' and this object" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:13:16.170099 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:16.170080    2573 scope.go:117] "RemoveContainer" containerID="0c569d39da81c82f8bbaf187160a8f0569952d6518e02046ce6c03d403f02a99"
Jul 28 18:13:16.172331 ip-10-0-142-249 kubenswrapper[2573]: E0728 18:13:16.172306    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-m59tv\" is forbidden: User \"system:node:ip-10-0-142-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-p4wgg\": no relationship found between node 'ip-10-0-142-249.ec2.internal' and this object" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" pod="openshift-must-gather-p4wgg/must-gather-m59tv"
Jul 28 18:13:16.296515 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:16.296479    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:16.366563 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:16.366529    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjn2t_02df3d99-6357-4957-a7d5-3734ffd68714/konnectivity-agent/0.log" limit=1024
Jul 28 18:13:16.899974 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:16.899902    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" path="/var/lib/kubelet/pods/e3de8f7e-8122-45fa-bb7e-a9726dbece3d/volumes"
Jul 28 18:13:17.414325 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:17.414286    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-kd2cp_bc0e165e-19bc-412d-9e35-8358fd6331bd/kube-state-metrics/0.log"
Jul 28 18:13:17.466994 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:17.466962    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-kd2cp_bc0e165e-19bc-412d-9e35-8358fd6331bd/kube-rbac-proxy-main/0.log"
Jul 28 18:13:17.505135 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:17.505088    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-kd2cp_bc0e165e-19bc-412d-9e35-8358fd6331bd/kube-rbac-proxy-self/0.log"
Jul 28 18:13:17.588002 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:17.587905    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-59lm6_6ab4b07c-f955-4621-afa1-d4dc5e5a977a/monitoring-plugin/0.log"
Jul 28 18:13:17.868242 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:17.868216    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmlcd_09324273-4fa4-4658-833d-9caa9f7eed82/node-exporter/0.log"
Jul 28 18:13:17.904343 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:17.904313    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmlcd_09324273-4fa4-4658-833d-9caa9f7eed82/kube-rbac-proxy/0.log"
Jul 28 18:13:17.931915 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:17.931888    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bmlcd_09324273-4fa4-4658-833d-9caa9f7eed82/init-textfile/0.log"
Jul 28 18:13:18.094694 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.094664    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eedb243a-c118-4bdf-9ae0-7c71131dcff7/prometheus/0.log"
Jul 28 18:13:18.124996 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.124931    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eedb243a-c118-4bdf-9ae0-7c71131dcff7/config-reloader/0.log"
Jul 28 18:13:18.157980 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.157948    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eedb243a-c118-4bdf-9ae0-7c71131dcff7/thanos-sidecar/0.log"
Jul 28 18:13:18.196180 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.196150    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eedb243a-c118-4bdf-9ae0-7c71131dcff7/kube-rbac-proxy-web/0.log"
Jul 28 18:13:18.229174 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.229138    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eedb243a-c118-4bdf-9ae0-7c71131dcff7/kube-rbac-proxy/0.log"
Jul 28 18:13:18.266905 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.266877    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eedb243a-c118-4bdf-9ae0-7c71131dcff7/kube-rbac-proxy-thanos/0.log"
Jul 28 18:13:18.296598 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.296574    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eedb243a-c118-4bdf-9ae0-7c71131dcff7/init-config-reloader/0.log"
Jul 28 18:13:18.340499 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.340471    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-mf6rf_70f448d3-6467-48a8-91e0-afbf1c15ee27/prometheus-operator/0.log"
Jul 28 18:13:18.375300 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.375221    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-mf6rf_70f448d3-6467-48a8-91e0-afbf1c15ee27/kube-rbac-proxy/0.log"
Jul 28 18:13:18.412962 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.412934    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-gqd9k_a1d80833-a013-4c48-a14d-6e9d41b33117/prometheus-operator-admission-webhook/0.log"
Jul 28 18:13:18.577352 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.577316    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585b79fb69-qx685_b21cd6e4-0e51-4e64-b185-d608d847dd56/thanos-query/0.log"
Jul 28 18:13:18.628932 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.628846    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585b79fb69-qx685_b21cd6e4-0e51-4e64-b185-d608d847dd56/kube-rbac-proxy-web/0.log"
Jul 28 18:13:18.676707 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.676669    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585b79fb69-qx685_b21cd6e4-0e51-4e64-b185-d608d847dd56/kube-rbac-proxy/0.log"
Jul 28 18:13:18.717489 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.717449    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585b79fb69-qx685_b21cd6e4-0e51-4e64-b185-d608d847dd56/prom-label-proxy/0.log"
Jul 28 18:13:18.744352 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.744323    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585b79fb69-qx685_b21cd6e4-0e51-4e64-b185-d608d847dd56/kube-rbac-proxy-rules/0.log"
Jul 28 18:13:18.786547 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:18.786520    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585b79fb69-qx685_b21cd6e4-0e51-4e64-b185-d608d847dd56/kube-rbac-proxy-metrics/0.log"
Jul 28 18:13:20.840757 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.840723    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"]
Jul 28 18:13:20.841142 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.841016    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerName="copy"
Jul 28 18:13:20.841142 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.841026    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerName="copy"
Jul 28 18:13:20.841142 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.841038    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerName="gather"
Jul 28 18:13:20.841142 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.841043    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerName="gather"
Jul 28 18:13:20.841142 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.841103    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerName="copy"
Jul 28 18:13:20.841142 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.841114    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3de8f7e-8122-45fa-bb7e-a9726dbece3d" containerName="gather"
Jul 28 18:13:20.845135 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.845112    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.847847 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.847816    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd4v4\"/\"kube-root-ca.crt\""
Jul 28 18:13:20.849091 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.849072    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vd4v4\"/\"openshift-service-ca.crt\""
Jul 28 18:13:20.849202 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.849074    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vd4v4\"/\"default-dockercfg-6vjwt\""
Jul 28 18:13:20.856164 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.856136    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"]
Jul 28 18:13:20.877968 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.877931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mbr9\" (UniqueName: \"kubernetes.io/projected/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-kube-api-access-2mbr9\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.878136 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.877977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-sys\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.878136 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.878034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-proc\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.878136 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.878099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-podres\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.878136 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.878135    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-lib-modules\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.978949 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.978907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-sys\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.978949 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.978944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-proc\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.979180 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.978982    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-podres\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.979180 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.979000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-lib-modules\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.979180 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.979045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mbr9\" (UniqueName: \"kubernetes.io/projected/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-kube-api-access-2mbr9\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.979180 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.979055    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-sys\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.979180 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.979093    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-proc\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.979180 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.979143    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-podres\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.979180 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.979160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-lib-modules\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:20.988802 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:20.988770    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mbr9\" (UniqueName: \"kubernetes.io/projected/9b8e5559-fef6-44e0-8add-a2b2f86f60bf-kube-api-access-2mbr9\") pod \"perf-node-gather-daemonset-zflzm\" (UID: \"9b8e5559-fef6-44e0-8add-a2b2f86f60bf\") " pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:21.156019 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:21.155977    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:21.309047 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:21.309004    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"]
Jul 28 18:13:21.314961 ip-10-0-142-249 kubenswrapper[2573]: W0728 18:13:21.314929    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9b8e5559_fef6_44e0_8add_a2b2f86f60bf.slice/crio-93ec2d18a45e663218b1e758e33d133a1d94ece2483f3f5c8af2bb26076f10ed WatchSource:0}: Error finding container 93ec2d18a45e663218b1e758e33d133a1d94ece2483f3f5c8af2bb26076f10ed: Status 404 returned error can't find the container with id 93ec2d18a45e663218b1e758e33d133a1d94ece2483f3f5c8af2bb26076f10ed
Jul 28 18:13:22.186749 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:22.186716    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm" event={"ID":"9b8e5559-fef6-44e0-8add-a2b2f86f60bf","Type":"ContainerStarted","Data":"06b77ddb6d90f06dd7d3088ea9d21f766aa3348ec36d2461f93cfc96edf0e52b"}
Jul 28 18:13:22.187159 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:22.186775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm" event={"ID":"9b8e5559-fef6-44e0-8add-a2b2f86f60bf","Type":"ContainerStarted","Data":"93ec2d18a45e663218b1e758e33d133a1d94ece2483f3f5c8af2bb26076f10ed"}
Jul 28 18:13:22.187159 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:22.186823    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:22.205013 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:22.204960    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm" podStartSLOduration=2.204943583 podStartE2EDuration="2.204943583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 18:13:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 18:13:22.204006668 +0000 UTC m=+3057.781601558" watchObservedRunningTime="2026-07-28 18:13:22.204943583 +0000 UTC m=+3057.782538460"
Jul 28 18:13:22.650343 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:22.650316    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfjmc_dceaf718-af8e-484c-b1ef-5b7fa813199d/dns/0.log"
Jul 28 18:13:22.684311 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:22.684277    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hfjmc_dceaf718-af8e-484c-b1ef-5b7fa813199d/kube-rbac-proxy/0.log"
Jul 28 18:13:22.781310 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:22.781276    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-phdpq_b9300d83-29e9-46dd-9817-a33dae58c8e8/dns-node-resolver/0.log"
Jul 28 18:13:23.397266 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:23.397231    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-86vmd_6df1c290-c341-40cc-9644-82a9a471aa55/node-ca/0.log"
Jul 28 18:13:24.175452 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:24.175423    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-788fb89859-4pbk2_1865e52e-e8a6-4af7-abcf-fe9518e45bfd/router/0.log"
Jul 28 18:13:24.581305 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:24.581231    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-g7pmp_123ab06e-cb59-4cef-a66e-50dd483a4721/serve-healthcheck-canary/0.log"
Jul 28 18:13:25.227540 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:25.227512    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pb7j9_4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2/kube-rbac-proxy/0.log"
Jul 28 18:13:25.257520 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:25.257494    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pb7j9_4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2/exporter/0.log"
Jul 28 18:13:25.285243 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:25.285215    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pb7j9_4c2e72a7-d6cb-4286-a54d-4dbe74eb38f2/extractor/0.log"
Jul 28 18:13:27.955632 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:27.955591    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-hb9p4_96e57dd2-02f4-42b6-9186-c5106fbccfbe/s3-init/0.log"
Jul 28 18:13:27.975865 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:27.975838    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-hb9p4_96e57dd2-02f4-42b6-9186-c5106fbccfbe/download-hf-model/0.log"
Jul 28 18:13:28.199452 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:28.199422    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vd4v4/perf-node-gather-daemonset-zflzm"
Jul 28 18:13:32.692537 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:32.692456    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-vnfdt_a4b26e1e-6d56-42a4-8e1a-444211794c96/migrator/0.log"
Jul 28 18:13:32.724728 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:32.724695    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-vnfdt_a4b26e1e-6d56-42a4-8e1a-444211794c96/graceful-termination/0.log"
Jul 28 18:13:34.421404 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.421376    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cljj_48a906e9-1a35-4b42-ac4d-0ef51c3f3551/kube-multus-additional-cni-plugins/0.log"
Jul 28 18:13:34.451281 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.451256    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cljj_48a906e9-1a35-4b42-ac4d-0ef51c3f3551/egress-router-binary-copy/0.log"
Jul 28 18:13:34.489429 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.489403    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cljj_48a906e9-1a35-4b42-ac4d-0ef51c3f3551/cni-plugins/0.log"
Jul 28 18:13:34.525076 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.525046    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cljj_48a906e9-1a35-4b42-ac4d-0ef51c3f3551/bond-cni-plugin/0.log"
Jul 28 18:13:34.556709 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.556679    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cljj_48a906e9-1a35-4b42-ac4d-0ef51c3f3551/routeoverride-cni/0.log"
Jul 28 18:13:34.588981 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.588945    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cljj_48a906e9-1a35-4b42-ac4d-0ef51c3f3551/whereabouts-cni-bincopy/0.log"
Jul 28 18:13:34.619008 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.618975    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cljj_48a906e9-1a35-4b42-ac4d-0ef51c3f3551/whereabouts-cni/0.log"
Jul 28 18:13:34.890573 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.890546    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rdwl9_dbdecd91-1a3f-4f4a-836b-72bbd64dcb62/kube-multus/0.log"
Jul 28 18:13:34.952522 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.952495    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jzkgz_ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1/network-metrics-daemon/0.log"
Jul 28 18:13:34.982101 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:34.982071    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jzkgz_ac6cb7b0-9b28-42ba-a6a7-ab3cb35c9dd1/kube-rbac-proxy/0.log"
Jul 28 18:13:36.199419 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:36.199388    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gglbf_a9688db4-1f96-436c-8543-1d8b36b15713/ovn-controller/0.log"
Jul 28 18:13:36.232874 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:36.232843    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gglbf_a9688db4-1f96-436c-8543-1d8b36b15713/ovn-acl-logging/0.log"
Jul 28 18:13:36.276018 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:36.275987    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gglbf_a9688db4-1f96-436c-8543-1d8b36b15713/kube-rbac-proxy-node/0.log"
Jul 28 18:13:36.303707 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:36.303673    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gglbf_a9688db4-1f96-436c-8543-1d8b36b15713/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 18:13:36.326328 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:36.326299    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gglbf_a9688db4-1f96-436c-8543-1d8b36b15713/northd/0.log"
Jul 28 18:13:36.353314 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:36.353291    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gglbf_a9688db4-1f96-436c-8543-1d8b36b15713/nbdb/0.log"
Jul 28 18:13:36.380157 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:36.380127    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gglbf_a9688db4-1f96-436c-8543-1d8b36b15713/sbdb/0.log"
Jul 28 18:13:36.422283 ip-10-0-142-249 kubenswrapper[2573]: I0728 18:13:36.422255    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gglbf_a9688db4-1f96-436c-8543-1d8b36b15713/ovnkube-controller/0.log"