Jul 27 17:44:24.394739 ip-10-0-133-79 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 17:44:24.394754 ip-10-0-133-79 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 17:44:24.394764 ip-10-0-133-79 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 17:44:24.395129 ip-10-0-133-79 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 17:44:34.487973 ip-10-0-133-79 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 17:44:34.487990 ip-10-0-133-79 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 73246de149dd446bb10de5892ad8e638 -- Jul 27 17:46:33.095704 ip-10-0-133-79 systemd[1]: Starting Kubernetes Kubelet... Jul 27 17:46:33.490430 ip-10-0-133-79 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 17:46:33.490430 ip-10-0-133-79 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 17:46:33.490430 ip-10-0-133-79 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 17:46:33.490430 ip-10-0-133-79 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 17:46:33.490430 ip-10-0-133-79 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 17:46:33.491147 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.490499 2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 17:46:33.496257 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496237 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:46:33.496257 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496256 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496261 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496264 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496268 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496271 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496273 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496277 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496279 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496282 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496284 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496287 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496290 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496292 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496295 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496297 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496300 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496302 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496305 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496307 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496310 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:46:33.496357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496312 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496315 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496318 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496320 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496323 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496350 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496354 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496356 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496359 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496361 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496364 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496367 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496369 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496372 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496375 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496377 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496380 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496383 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496385 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496388 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:46:33.496845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496390 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496393 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496395 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496398 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496401 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496403 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496406 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496408 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496412 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496414 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496417 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496421 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496423 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496428 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496431 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496436 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496440 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496444 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496447 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:46:33.497385 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496451 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496454 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496457 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496459 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496462 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496464 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496467 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496469 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496474 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496477 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496480 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496483 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496485 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496488 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496491 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496494 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496497 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496499 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496502 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496504 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:46:33.497844 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496506 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496509 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496511 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496514 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496516 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496520 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496523 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496526 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496528 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496531 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496534 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496536 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496539 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496541 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496544 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496546 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496549 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496551 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.496554 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497292 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:46:33.498326 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497299 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497302 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497305 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497309 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497311 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497314 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497317 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497320 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497328 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497349 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497352 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497355 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497358 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497361 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497364 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497367 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497369 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497372 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497377 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497380 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:46:33.498836 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497384 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497387 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497390 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497393 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497395 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497398 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497401 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497404 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497407 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497410 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497412 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497415 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497417 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497421 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497425 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497428 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497431 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497434 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497437 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:46:33.499363 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497440 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497443 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497447 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497450 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497453 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497456 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497459 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497463 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497466 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497468 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497471 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497474 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497477 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497479 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497482 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497485 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497487 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497490 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497493 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497495 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:46:33.499845 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497498 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497501 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497503 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497506 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497508 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497511 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497514 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497516 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497519 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497522 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497524 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497527 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497530 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497532 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497535 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497539 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497542 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497545 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497547 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497551 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:46:33.500349 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497554 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497556 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497559 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497562 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497564 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497567 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497569 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497572 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497575 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497577 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497580 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497582 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497585 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497588 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497592 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497596 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497599 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497602 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.497605 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:46:33.500868 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498048 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498053 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498056 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498060 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498063 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498066 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498072 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498075 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498078 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498081 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498084 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498087 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498090 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498092 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498095 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498099 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498102 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498104 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498107 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498110 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:46:33.501344 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498113 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498115 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498118 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498121 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498124 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498127 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498129 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498132 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498135 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498138 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498141 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498143 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498146 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498149 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498151 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498154 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498156 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498159 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498163 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498167 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:46:33.501872 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498170 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498173 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498176 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498178 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498181 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498184 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498186 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498189 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498191 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498194 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498197 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498201 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498204 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498208 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498210 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498213 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498216 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498219 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498221 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:46:33.502404 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498224 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498226 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498229 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498232 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498234 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498237 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498239 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498242 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498244 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498247 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498249 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498254 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498258 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498260 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498263 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498266 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498269 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498272 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498275 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498277 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:46:33.502894 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498281 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498283 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498286 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498288 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498291 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498293 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498296 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498299 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498301 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498305 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498309 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498313 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498316 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498320 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498323 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498325 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498328 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498331 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498351 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:46:33.503413 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.498354 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498426 2585 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498434 2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498440 2585 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498445 2585 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498451 2585 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498454 2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498459 2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498463 2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498468 2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498472 2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498475 2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498481 2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498485 2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498488 2585 flags.go:64] FLAG: --cgroup-root="" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498491 2585 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498494 2585 flags.go:64] FLAG: --client-ca-file="" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498496 2585 flags.go:64] FLAG: --cloud-provider="external" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498499 2585 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498504 2585 flags.go:64] FLAG: --cluster-domain="" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498507 2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498510 2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498513 2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498517 2585 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 17:46:33.503907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498521 2585 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498524 2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498527 2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498530 2585 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498533 2585 flags.go:64] FLAG: --contention-profiling="false" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498536 2585 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498539 2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498542 2585 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498545 2585 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498550 2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498553 2585 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498556 2585 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498559 2585 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498563 2585 flags.go:64] FLAG: --enable-server="true" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498567 2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498571 2585 flags.go:64] FLAG: --event-burst="100" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498574 2585 flags.go:64] FLAG: --event-qps="50" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498577 2585 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498581 2585 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498584 2585 flags.go:64] FLAG: --eviction-hard="" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498588 2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498591 2585 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498594 2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498597 2585 flags.go:64] FLAG: --eviction-soft="" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498600 2585 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 17:46:33.504511 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498603 2585 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498606 2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498609 2585 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498612 2585 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498615 2585 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498618 2585 flags.go:64] FLAG: --feature-gates="" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498622 2585 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498625 2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498628 2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498631 2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498634 2585 flags.go:64] FLAG: --healthz-port="10248" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498637 2585 flags.go:64] FLAG: --help="false" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498640 2585 flags.go:64] FLAG: --hostname-override="ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498643 2585 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498646 2585 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498649 2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498652 2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498656 2585 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498659 2585 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498662 2585 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498666 2585 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498669 2585 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498672 2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498676 2585 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 17:46:33.505127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498678 2585 flags.go:64] FLAG: --kube-reserved="" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498681 2585 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498685 2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498688 2585 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498691 2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498694 2585 flags.go:64] FLAG: --lock-file="" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498697 2585 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498700 2585 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498703 2585 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498708 2585 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498711 2585 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498714 2585 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498717 2585 flags.go:64] FLAG: --logging-format="text" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498719 2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498723 2585 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498726 2585 flags.go:64] FLAG: --manifest-url="" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498729 2585 flags.go:64] FLAG: --manifest-url-header="" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498733 2585 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498736 2585 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498740 2585 flags.go:64] FLAG: --max-pods="110" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498743 2585 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498746 2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498749 2585 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498752 2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498755 2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 17:46:33.505820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498758 2585 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498761 2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498768 2585 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498772 2585 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498775 2585 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498778 2585 flags.go:64] FLAG: --pod-cidr="" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498781 2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498786 2585 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498789 2585 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498792 2585 flags.go:64] FLAG: --pods-per-core="0" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498796 2585 flags.go:64] FLAG: --port="10250" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498799 2585 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498802 2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0efe5ca01eb8c1180" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498805 2585 flags.go:64] FLAG: --qos-reserved="" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498808 2585 flags.go:64] FLAG: --read-only-port="10255" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498810 2585 flags.go:64] FLAG: --register-node="true" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498814 2585 flags.go:64] FLAG: --register-with-taints="" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498817 2585 flags.go:64] FLAG: --registry-burst="10" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498820 2585 flags.go:64] FLAG: --registry-qps="5" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498823 2585 flags.go:64] FLAG: --reserved-cpus="" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498826 2585 flags.go:64] FLAG: --reserved-memory="" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498829 2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498832 2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498835 2585 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498838 2585 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 17:46:33.506909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498841 2585 flags.go:64] FLAG: --runonce="false" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498844 2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498847 2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498850 2585 flags.go:64] FLAG: --seccomp-default="false" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498853 2585 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498857 2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498862 2585 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498866 2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498873 2585 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498877 2585 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498880 2585 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498883 2585 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498886 2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498889 2585 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498892 2585 flags.go:64] FLAG: --system-cgroups="" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498895 2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498901 2585 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498903 2585 flags.go:64] FLAG: --tls-cert-file="" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498907 2585 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498912 2585 flags.go:64] FLAG: --tls-min-version="" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498914 2585 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498917 2585 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498920 2585 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498923 2585 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498926 2585 flags.go:64] FLAG: --v="2" Jul 27 17:46:33.507990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498930 2585 flags.go:64] FLAG: --version="false" Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498934 2585 flags.go:64] FLAG: --vmodule="" Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498937 2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.498940 2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499056 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499061 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499065 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499068 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499071 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499074 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499076 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499079 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499082 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499084 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499087 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499091 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499094 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499097 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499099 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499102 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:46:33.509134 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499105 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499108 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499111 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499114 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499116 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499119 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499122 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499125 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499128 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499130 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499133 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499135 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499138 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499141 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499143 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499146 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499148 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499151 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499153 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499156 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:46:33.509819 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499159 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499161 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499164 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499167 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499169 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499172 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499175 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499178 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499181 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499184 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499186 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499189 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499192 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499194 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499197 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499199 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499202 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499205 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499209 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499213 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:46:33.510503 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499216 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499218 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499221 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499224 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499226 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499229 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499231 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499234 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499236 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499239 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499242 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499244 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499248 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499251 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499254 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499257 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499260 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499263 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499266 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:46:33.511357 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499270 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499272 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499275 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499277 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499280 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499283 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499285 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499288 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499291 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499293 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499296 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499299 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499301 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499304 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499307 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499309 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499312 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499314 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499317 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499328 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:46:33.512029 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499345 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499348 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499351 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.499353 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.499955 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.507952 2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.507972 2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.507999 2585 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.508012 2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508095 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508103 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508108 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508113 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508117 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:46:33.512680 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508121 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508125 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508129 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508134 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508139 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508143 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508147 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508151 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508155 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508160 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508165 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508170 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508175 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508179 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508184 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508188 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508192 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508196 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508200 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508204 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:46:33.513071 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508210 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508217 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508221 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508225 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508230 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508234 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508239 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508246 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508252 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508256 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508262 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508266 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508270 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508274 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508279 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508283 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508288 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508292 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508296 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508300 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:46:33.513600 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508304 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508310 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508315 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508319 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508324 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508328 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508353 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508358 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508363 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508367 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508371 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508376 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508381 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508386 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508390 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508394 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508399 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508404 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508408 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508412 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:46:33.514152 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508417 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508421 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508425 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508430 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508434 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508438 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508443 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508447 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508452 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508456 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508461 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508465 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508469 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508473 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508477 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508482 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508486 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508491 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508495 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508499 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:46:33.514761 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508503 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508508 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508513 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508519 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508525 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508531 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508536 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508540 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508571 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508577 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508582 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508587 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508592 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508597 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:46:33.515272 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.508605 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508789 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508797 2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508803 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508808 2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508813 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508818 2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508822 2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508827 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508831 2585 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508835 2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508839 2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508843 2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508848 2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508852 2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508857 2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508862 2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508866 2585 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508870 2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:46:33.515660 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508875 2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508879 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508883 2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508887 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508892 2585 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508897 2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508901 2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508905 2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508909 2585 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508914 2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508918 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508922 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508926 2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508930 2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508935 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508939 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508943 2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508947 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508952 2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508956 2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:46:33.516301 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508960 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508964 2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508970 2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508975 2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508979 2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508983 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508987 2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508992 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.508996 2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509001 2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509005 2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509010 2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509014 2585 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509018 2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509022 2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509026 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509030 2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509035 2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509039 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509043 2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:46:33.517125 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509047 2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509052 2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509056 2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509060 2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509064 2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509068 2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509072 2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509077 2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509081 2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509087 2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509092 2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509098 2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509102 2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509107 2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509112 2585 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509117 2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509121 2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509126 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509130 2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:46:33.517749 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509135 2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509141 2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509145 2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509150 2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509155 2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509159 2585 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509164 2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509168 2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509172 2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509176 2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509180 2585 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509185 2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509189 2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509193 2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509198 2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509202 2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509206 2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509210 2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509214 2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509218 2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:46:33.518212 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509223 2585 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:46:33.518744 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:33.509227 2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:46:33.518744 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.509235 2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 17:46:33.518744 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.509429 2585 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 17:46:33.518744 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.512198 2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 17:46:33.518744 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.513661 2585 server.go:1019] "Starting client certificate rotation" Jul 27 17:46:33.518744 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.513764 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 17:46:33.518744 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.513800 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 17:46:33.518744 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.516528 2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 17:46:33.520287 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.520269 2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 17:46:33.530786 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.530769 2585 log.go:25] "Validated CRI v1 runtime API" Jul 27 17:46:33.532817 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.532805 2585 log.go:25] "Validated CRI v1 image API" Jul 27 17:46:33.533616 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.533602 2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 17:46:33.538157 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.538138 2585 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cd0eec40-9fd1-4ef3-a149-8fcc459df41e:/dev/nvme0n1p4 e30509dd-54c9-405e-bb08-686e0341ab21:/dev/nvme0n1p3] Jul 27 17:46:33.538214 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.538157 2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 17:46:33.543417 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.543399 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 17:46:33.544471 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.544358 2585 manager.go:216] Machine: {Timestamp:2026-07-27 17:46:33.542057702 +0000 UTC m=+0.329187919 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092721 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec243ab2884f5cbb16845ec8a3bb2416 SystemUUID:ec243ab2-884f-5cbb-1684-5ec8a3bb2416 BootID:73246de1-49dd-446b-b10d-e5892ad8e638 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:3a:bc:7d:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:3a:bc:7d:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:16:f7:83:b2:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 17:46:33.544552 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.544471 2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 17:46:33.544582 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.544557 2585 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 17:46:33.547412 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.547388 2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 17:46:33.547547 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.547414 2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 17:46:33.548207 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.548197 2585 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 17:46:33.548240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.548210 2585 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 17:46:33.548240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.548217 2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 17:46:33.549118 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.549108 2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 17:46:33.550029 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.550019 2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 17:46:33.552201 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552190 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 27 17:46:33.552350 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552325 2585 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 17:46:33.552383 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552370 2585 kubelet.go:486] "Attempting to sync node with API server" Jul 27 17:46:33.552383 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552379 2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 17:46:33.552461 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552398 2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 17:46:33.552461 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552408 2585 kubelet.go:398] "Adding apiserver pod source" Jul 27 17:46:33.552461 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552416 2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 17:46:33.552787 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552774 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 17:46:33.552847 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.552795 2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 17:46:33.555587 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.555567 2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 17:46:33.557607 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.557595 2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 17:46:33.557656 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.557626 2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 17:46:33.559764 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559751 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 17:46:33.559809 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559771 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 17:46:33.559809 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559778 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 17:46:33.559809 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559783 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 17:46:33.559809 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559791 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 17:46:33.559809 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559796 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 17:46:33.559809 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559804 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 17:46:33.559809 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559809 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 17:46:33.559989 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559815 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 17:46:33.559989 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559820 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 17:46:33.559989 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559828 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 17:46:33.559989 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.559834 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 17:46:33.561741 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.561729 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 17:46:33.561741 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.561742 2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 17:46:33.563884 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.563853 2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 17:46:33.564356 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.564302 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 17:46:33.564391 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.564302 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 17:46:33.565088 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.565078 2585 server.go:1268] "Started kubelet" Jul 27 17:46:33.565430 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.565402 2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 17:46:33.565527 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.565452 2585 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 17:46:33.565740 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.565634 2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 17:46:33.566120 ip-10-0-133-79 systemd[1]: Started Kubernetes Kubelet. Jul 27 17:46:33.567012 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.566991 2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 17:46:33.570936 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.570910 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m8m4x" Jul 27 17:46:33.572223 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.572174 2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 17:46:33.572305 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.572231 2585 server.go:310] "Adding debug handlers to kubelet server" Jul 27 17:46:33.576570 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.576550 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m8m4x" Jul 27 17:46:33.577952 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.577931 2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 17:46:33.578061 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.577998 2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 17:46:33.578061 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.578016 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:33.578528 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.578508 2585 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 17:46:33.578528 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.578529 2585 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 17:46:33.578677 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.578588 2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 17:46:33.578677 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.578633 2585 reconstruct.go:97] "Volume reconstruction finished" Jul 27 17:46:33.578677 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.578641 2585 reconciler.go:29] "Reconciler: start to sync state" Jul 27 17:46:33.579501 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.579483 2585 factory.go:55] Registering systemd factory Jul 27 17:46:33.579501 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.579503 2585 factory.go:223] Registration of the systemd container factory successfully Jul 27 17:46:33.579696 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.578699 2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-79.ec2.internal.18c636a7169064e4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-79.ec2.internal,UID:ip-10-0-133-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-79.ec2.internal,},FirstTimestamp:2026-07-27 17:46:33.564980452 +0000 UTC m=+0.352110670,LastTimestamp:2026-07-27 17:46:33.564980452 +0000 UTC m=+0.352110670,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-79.ec2.internal,}" Jul 27 17:46:33.579782 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.579765 2585 factory.go:153] Registering CRI-O factory Jul 27 17:46:33.579841 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.579791 2585 factory.go:223] Registration of the crio container factory successfully Jul 27 17:46:33.579841 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.579839 2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 17:46:33.579914 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.579861 2585 factory.go:103] Registering Raw factory Jul 27 17:46:33.579914 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.579875 2585 manager.go:1196] Started watching for new ooms in manager Jul 27 17:46:33.580306 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.580292 2585 manager.go:349] Starting recovery of all containers Jul 27 17:46:33.591036 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.590896 2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 17:46:33.591036 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.590991 2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 17:46:33.591872 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.591854 2585 manager.go:354] Recovery completed Jul 27 17:46:33.595837 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.595824 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:46:33.599112 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.599094 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:46:33.599182 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.599126 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:46:33.599182 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.599140 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:46:33.600046 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.600030 2585 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 17:46:33.600046 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.600038 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:46:33.600046 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.600045 2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 17:46:33.600222 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.600063 2585 state_mem.go:36] "Initialized new in-memory state store" Jul 27 17:46:33.600838 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.600821 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:46:33.600901 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.600844 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:46:33.600901 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.600854 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:46:33.601512 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.601498 2585 policy_none.go:49] "None policy: Start" Jul 27 17:46:33.601562 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.601516 2585 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 17:46:33.601562 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.601527 2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 17:46:33.602470 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.602459 2585 policy_none.go:47] "Start" Jul 27 17:46:33.642329 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.642307 2585 manager.go:337] "Starting Device Plugin manager" Jul 27 17:46:33.642448 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.642369 2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 17:46:33.642448 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.642385 2585 server.go:87] "Starting device plugin registration server" Jul 27 17:46:33.642673 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.642658 2585 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 17:46:33.642714 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.642677 2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 17:46:33.642795 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.642777 2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 17:46:33.642890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.642872 2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 17:46:33.642890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.642886 2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 17:46:33.643644 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.643623 2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 17:46:33.643724 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.643678 2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:33.743886 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.743810 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:46:33.745127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.744893 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:46:33.745127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.744946 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:46:33.745127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.744962 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:46:33.745127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.744997 2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.752434 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.752416 2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.752516 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.752442 2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-79.ec2.internal\": node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:33.757240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.757217 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 17:46:33.758653 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.758637 2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 17:46:33.758733 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.758679 2585 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 17:46:33.758733 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.758700 2585 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 17:46:33.758803 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.758740 2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 17:46:33.761063 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.761040 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:46:33.794308 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.794274 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:33.859282 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.859242 2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal"] Jul 27 17:46:33.859469 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.859394 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:46:33.860465 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.860444 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:46:33.860563 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.860479 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:46:33.860563 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.860490 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:46:33.861805 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.861790 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:46:33.861950 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.861936 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.861990 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.861969 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:46:33.862557 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.862541 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:46:33.862661 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.862541 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:46:33.862661 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.862604 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:46:33.862661 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.862622 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:46:33.862661 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.862567 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:46:33.862835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.862665 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:46:33.863936 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.863921 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.863989 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.863954 2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:46:33.868357 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.868320 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:46:33.868451 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.868374 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:46:33.868451 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.868388 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:46:33.877929 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.877901 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-79.ec2.internal\" not found" node="ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.880953 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.880931 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae3551dcd8750d735f309652b0dd3b84-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"ae3551dcd8750d735f309652b0dd3b84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.881074 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.880957 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae3551dcd8750d735f309652b0dd3b84-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"ae3551dcd8750d735f309652b0dd3b84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.881074 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.880974 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ed7cbd15715a6bdb7dcea8103b7a8dc-config\") pod \"kube-apiserver-proxy-ip-10-0-133-79.ec2.internal\" (UID: \"9ed7cbd15715a6bdb7dcea8103b7a8dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.883387 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.883359 2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-79.ec2.internal\" not found" node="ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.894407 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.894380 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:33.981901 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.981865 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae3551dcd8750d735f309652b0dd3b84-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"ae3551dcd8750d735f309652b0dd3b84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.981901 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.981901 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ed7cbd15715a6bdb7dcea8103b7a8dc-config\") pod \"kube-apiserver-proxy-ip-10-0-133-79.ec2.internal\" (UID: \"9ed7cbd15715a6bdb7dcea8103b7a8dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.982029 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.981916 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae3551dcd8750d735f309652b0dd3b84-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"ae3551dcd8750d735f309652b0dd3b84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.982029 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.981966 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae3551dcd8750d735f309652b0dd3b84-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"ae3551dcd8750d735f309652b0dd3b84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.982029 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.981985 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9ed7cbd15715a6bdb7dcea8103b7a8dc-config\") pod \"kube-apiserver-proxy-ip-10-0-133-79.ec2.internal\" (UID: \"9ed7cbd15715a6bdb7dcea8103b7a8dc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.982029 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:33.981968 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae3551dcd8750d735f309652b0dd3b84-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal\" (UID: \"ae3551dcd8750d735f309652b0dd3b84\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:33.995046 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:33.994977 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:34.095905 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:34.095861 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:35.818277 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:35.818249 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:35.823155 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:35.823134 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" Jul 27 17:46:35.833408 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:35.833388 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:35.934088 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:35.933991 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:36.034498 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:36.034464 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:36.135161 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:36.135126 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:36.150313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.150277 2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 17:46:36.150472 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.150424 2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 17:46:36.227568 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.227476 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 17:41:35 +0000 UTC" deadline="2028-01-22 12:04:50.268202499 +0000 UTC" Jul 27 17:46:36.227568 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.227511 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13050h18m14.040694921s" Jul 27 17:46:36.235652 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:36.235626 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:36.336331 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:36.336301 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:36.437010 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:36.436967 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:36.455127 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:36.455075 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed7cbd15715a6bdb7dcea8103b7a8dc.slice/crio-0d93bb47d560a3948e136e7ee2151f77ec01f88332074c1149656fbed6f8e56b WatchSource:0}: Error finding container 0d93bb47d560a3948e136e7ee2151f77ec01f88332074c1149656fbed6f8e56b: Status 404 returned error can't find the container with id 0d93bb47d560a3948e136e7ee2151f77ec01f88332074c1149656fbed6f8e56b Jul 27 17:46:36.455332 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:36.455307 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3551dcd8750d735f309652b0dd3b84.slice/crio-bcc3efc368994fa0a1f5a9d35a2f7078489664b297885f2008df7d1abed8536f WatchSource:0}: Error finding container bcc3efc368994fa0a1f5a9d35a2f7078489664b297885f2008df7d1abed8536f: Status 404 returned error can't find the container with id bcc3efc368994fa0a1f5a9d35a2f7078489664b297885f2008df7d1abed8536f Jul 27 17:46:36.459376 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.459358 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 17:46:36.537995 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:36.537900 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:36.562564 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.562542 2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:46:36.639007 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:36.638976 2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-79.ec2.internal\" not found" Jul 27 17:46:36.645617 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.645598 2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:46:36.715785 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.715755 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" Jul 27 17:46:36.731408 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.731385 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 17:46:36.732436 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.732420 2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" Jul 27 17:46:36.741299 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.741277 2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 17:46:36.743682 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:36.743666 2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:46:37.190745 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.190711 2585 apiserver.go:52] "Watching apiserver" Jul 27 17:46:37.202027 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.201994 2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 17:46:37.202470 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.202442 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xmb7v","openshift-network-operator/iptables-alerter-rh4dx","kube-system/konnectivity-agent-42gjx","kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal","openshift-cluster-node-tuning-operator/tuned-hgz6z","openshift-dns/node-resolver-dk8ws","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal","openshift-multus/multus-additional-cni-plugins-wlpr7","openshift-network-diagnostics/network-check-target-hdpfk","openshift-ovn-kubernetes/ovnkube-node-55xcz","kube-system/global-pull-secret-syncer-cn72p","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p","openshift-image-registry/node-ca-4rd4p","openshift-multus/multus-4z7sf"] Jul 27 17:46:37.205014 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.204995 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.207467 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.207443 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.209479 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.209459 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dsjww\"" Jul 27 17:46:37.209749 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.209732 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 17:46:37.210969 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.210085 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 17:46:37.210969 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.210315 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 17:46:37.210969 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.210569 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:46:37.211638 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.211381 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:46:37.212818 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.212395 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:37.212818 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.212719 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 17:46:37.216827 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.213534 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tswtn\"" Jul 27 17:46:37.216827 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.214806 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-799ng\"" Jul 27 17:46:37.216827 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.215053 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:37.216827 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.216542 2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 17:46:37.217196 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.216996 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 17:46:37.217196 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.217093 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 17:46:37.218436 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.218415 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 17:46:37.219691 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.219668 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.222441 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.222418 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:46:37.222676 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.222653 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-szb4h\"" Jul 27 17:46:37.222912 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.222896 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 17:46:37.223369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.223326 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.224541 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.224289 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.225755 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.225733 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 17:46:37.225914 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.225896 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5gdpp\"" Jul 27 17:46:37.226414 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.226333 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 17:46:37.226723 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.226505 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 17:46:37.226814 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.226738 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 17:46:37.226878 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.226854 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.227139 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.227118 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 17:46:37.227205 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.227190 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 17:46:37.227266 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.227250 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gg225\"" Jul 27 17:46:37.228217 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228197 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpt5r\" (UniqueName: \"kubernetes.io/projected/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-kube-api-access-fpt5r\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.228316 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228229 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-host\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228316 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228251 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59b068a7-7e63-4ac8-b8a7-328304640f51-host\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.228316 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228273 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59b068a7-7e63-4ac8-b8a7-328304640f51-serviceca\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.228316 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228298 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-iptables-alerter-script\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.228559 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228329 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-host-slash\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.228559 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228378 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41fa3362-3d22-4cd9-b5e6-cf1778ea8c02-konnectivity-ca\") pod \"konnectivity-agent-42gjx\" (UID: \"41fa3362-3d22-4cd9-b5e6-cf1778ea8c02\") " pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:46:37.228559 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228403 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysconfig\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228559 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228494 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-kubernetes\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228559 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228530 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-systemd\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228559 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228554 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26973888-256a-4027-8636-d0a422085792-tmp\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228578 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwn5\" (UniqueName: \"kubernetes.io/projected/59b068a7-7e63-4ac8-b8a7-328304640f51-kube-api-access-8xwn5\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228611 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228636 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-modprobe-d\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228657 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysctl-d\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228679 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysctl-conf\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228700 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-sys\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228723 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-var-lib-kubelet\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228750 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41fa3362-3d22-4cd9-b5e6-cf1778ea8c02-agent-certs\") pod \"konnectivity-agent-42gjx\" (UID: \"41fa3362-3d22-4cd9-b5e6-cf1778ea8c02\") " pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228775 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmrm7\" (UniqueName: \"kubernetes.io/projected/7fdc6818-a0a9-4b91-a91f-a077f73273f0-kube-api-access-gmrm7\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228797 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-run\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.228835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228828 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-lib-modules\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.229330 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228868 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26973888-256a-4027-8636-d0a422085792-etc-tuned\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.229330 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.228917 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwsfr\" (UniqueName: \"kubernetes.io/projected/26973888-256a-4027-8636-d0a422085792-kube-api-access-gwsfr\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.229330 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.229115 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 17:46:37.229584 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.229566 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k96rb\"" Jul 27 17:46:37.229731 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.229712 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 17:46:37.230802 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.230291 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:37.230802 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.230371 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:37.232867 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.232710 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.233286 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.233267 2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 17:46:37.235506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.235265 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.235506 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.235371 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:37.235723 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.235705 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 17:46:37.236170 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.236150 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 17:46:37.236281 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.236263 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 17:46:37.236451 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.236434 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 17:46:37.236609 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.236590 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bzx64\"" Jul 27 17:46:37.236765 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.236745 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 17:46:37.237887 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.237869 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.239207 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.238970 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 17:46:37.241191 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.240941 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 17:46:37.241191 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.240990 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwqdn\"" Jul 27 17:46:37.241333 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.241209 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 17:46:37.241535 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.241509 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 17:46:37.266590 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.266553 2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j4j6v" Jul 27 17:46:37.275331 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.275306 2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j4j6v" Jul 27 17:46:37.317542 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.317511 2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 17:46:37.329557 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329527 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmrm7\" (UniqueName: \"kubernetes.io/projected/7fdc6818-a0a9-4b91-a91f-a077f73273f0-kube-api-access-gmrm7\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:37.329557 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329560 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-run\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.329793 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329585 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-system-cni-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.329793 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329657 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-kubelet\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.329793 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329680 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-system-cni-dir\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.329793 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329705 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-systemd\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.329793 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329703 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-run\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.329793 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329729 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-socket-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.329793 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329772 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt477\" (UniqueName: \"kubernetes.io/projected/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-kube-api-access-tt477\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329816 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-netns\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329862 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-etc-kubernetes\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329906 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-env-overrides\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329934 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovn-node-metrics-cert\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.329981 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-iptables-alerter-script\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330017 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-k8s-cni-cncf-io\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330040 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovnkube-config\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330064 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c647f46c-9b00-443b-83b9-42d76ed6b23d-kubelet-config\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.330126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330102 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysctl-conf\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330165 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-cni-bin\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330196 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-device-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330223 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-sys-fs\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330246 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cnibin\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330257 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysctl-conf\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330280 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330308 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59b068a7-7e63-4ac8-b8a7-328304640f51-serviceca\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330332 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88f9b\" (UniqueName: \"kubernetes.io/projected/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-kube-api-access-88f9b\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330375 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-cni-bin\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330509 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-conf-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330534 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-log-socket\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330557 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330580 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330605 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.330625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330631 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41fa3362-3d22-4cd9-b5e6-cf1778ea8c02-konnectivity-ca\") pod \"konnectivity-agent-42gjx\" (UID: \"41fa3362-3d22-4cd9-b5e6-cf1778ea8c02\") " pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330632 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-iptables-alerter-script\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330656 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-kubernetes\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330682 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-tmp-dir\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330735 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-kubernetes\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330768 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-cni-multus\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330789 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-etc-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330810 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26973888-256a-4027-8636-d0a422085792-etc-tuned\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330810 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59b068a7-7e63-4ac8-b8a7-328304640f51-serviceca\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330829 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330862 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-modprobe-d\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330890 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-cnibin\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.330905 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330913 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-kubelet\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.330937 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.330957 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs podName:7fdc6818-a0a9-4b91-a91f-a077f73273f0 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:37.830942596 +0000 UTC m=+2.981069575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs") pod "network-metrics-daemon-xmb7v" (UID: "7fdc6818-a0a9-4b91-a91f-a077f73273f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331035 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-modprobe-d\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.331313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331087 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-lib-modules\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331103 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-hosts-file\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331118 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927ef834-1155-464c-8f29-8c08c7988908-cni-binary-copy\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331115 2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331148 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/41fa3362-3d22-4cd9-b5e6-cf1778ea8c02-konnectivity-ca\") pod \"konnectivity-agent-42gjx\" (UID: \"41fa3362-3d22-4cd9-b5e6-cf1778ea8c02\") " pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331161 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lslhw\" (UniqueName: \"kubernetes.io/projected/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-kube-api-access-lslhw\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331206 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-cni-netd\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331212 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-lib-modules\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331232 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c647f46c-9b00-443b-83b9-42d76ed6b23d-dbus\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331261 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpt5r\" (UniqueName: \"kubernetes.io/projected/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-kube-api-access-fpt5r\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331285 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-host\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331308 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59b068a7-7e63-4ac8-b8a7-328304640f51-host\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331330 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-os-release\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331372 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-multus-certs\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331392 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-host\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331423 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59b068a7-7e63-4ac8-b8a7-328304640f51-host\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331465 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.332148 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331496 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331522 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-run-netns\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331552 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-host-slash\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331587 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-host-slash\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331619 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysconfig\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331642 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26973888-256a-4027-8636-d0a422085792-tmp\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331664 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwn5\" (UniqueName: \"kubernetes.io/projected/59b068a7-7e63-4ac8-b8a7-328304640f51-kube-api-access-8xwn5\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331669 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysconfig\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331691 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-run-ovn-kubernetes\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331716 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331739 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-registration-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331761 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-etc-selinux\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331787 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysctl-d\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331809 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-sys\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331847 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-var-lib-kubelet\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331881 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41fa3362-3d22-4cd9-b5e6-cf1778ea8c02-agent-certs\") pod \"konnectivity-agent-42gjx\" (UID: \"41fa3362-3d22-4cd9-b5e6-cf1778ea8c02\") " pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331890 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-sys\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331908 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-hostroot\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331934 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-sysctl-d\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331967 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-var-lib-kubelet\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.331982 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-var-lib-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332016 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-socket-dir-parent\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332045 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-ovn\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332071 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332099 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-systemd\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332158 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-cni-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332188 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/927ef834-1155-464c-8f29-8c08c7988908-multus-daemon-config\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332220 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm4n8\" (UniqueName: \"kubernetes.io/projected/927ef834-1155-464c-8f29-8c08c7988908-kube-api-access-rm4n8\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332250 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-slash\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332254 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26973888-256a-4027-8636-d0a422085792-etc-systemd\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332273 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-node-log\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332297 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovnkube-script-lib\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332352 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2dpk\" (UniqueName: \"kubernetes.io/projected/f3fd385d-fd3f-4275-b7de-520e63ca583e-kube-api-access-d2dpk\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332384 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwsfr\" (UniqueName: \"kubernetes.io/projected/26973888-256a-4027-8636-d0a422085792-kube-api-access-gwsfr\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.333986 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332413 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-os-release\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.334829 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.332438 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-systemd-units\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.335463 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.335442 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26973888-256a-4027-8636-d0a422085792-etc-tuned\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.335579 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.335526 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26973888-256a-4027-8636-d0a422085792-tmp\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.336162 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.336063 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/41fa3362-3d22-4cd9-b5e6-cf1778ea8c02-agent-certs\") pod \"konnectivity-agent-42gjx\" (UID: \"41fa3362-3d22-4cd9-b5e6-cf1778ea8c02\") " pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:46:37.346111 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.346086 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpt5r\" (UniqueName: \"kubernetes.io/projected/e80149e4-bbab-4642-9e5d-f79ddbf3a41b-kube-api-access-fpt5r\") pod \"iptables-alerter-rh4dx\" (UID: \"e80149e4-bbab-4642-9e5d-f79ddbf3a41b\") " pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.346111 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.346092 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmrm7\" (UniqueName: \"kubernetes.io/projected/7fdc6818-a0a9-4b91-a91f-a077f73273f0-kube-api-access-gmrm7\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:37.348178 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.348147 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwsfr\" (UniqueName: \"kubernetes.io/projected/26973888-256a-4027-8636-d0a422085792-kube-api-access-gwsfr\") pod \"tuned-hgz6z\" (UID: \"26973888-256a-4027-8636-d0a422085792\") " pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.348446 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.348424 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwn5\" (UniqueName: \"kubernetes.io/projected/59b068a7-7e63-4ac8-b8a7-328304640f51-kube-api-access-8xwn5\") pod \"node-ca-4rd4p\" (UID: \"59b068a7-7e63-4ac8-b8a7-328304640f51\") " pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.400967 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.400908 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" event={"ID":"ae3551dcd8750d735f309652b0dd3b84","Type":"ContainerStarted","Data":"bcc3efc368994fa0a1f5a9d35a2f7078489664b297885f2008df7d1abed8536f"} Jul 27 17:46:37.402329 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.402292 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" event={"ID":"9ed7cbd15715a6bdb7dcea8103b7a8dc","Type":"ContainerStarted","Data":"0d93bb47d560a3948e136e7ee2151f77ec01f88332074c1149656fbed6f8e56b"} Jul 27 17:46:37.433286 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433251 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-systemd-units\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.433497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433327 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-system-cni-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.433497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433375 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-kubelet\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.433497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433398 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-system-cni-dir\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.433497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433421 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-systemd\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.433497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433443 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-system-cni-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.433497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433455 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-socket-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.433497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433485 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt477\" (UniqueName: \"kubernetes.io/projected/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-kube-api-access-tt477\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433511 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-netns\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433537 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-etc-kubernetes\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433561 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-env-overrides\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433586 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovn-node-metrics-cert\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433598 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-socket-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433610 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-k8s-cni-cncf-io\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433637 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovnkube-config\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433652 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-kubelet\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433664 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c647f46c-9b00-443b-83b9-42d76ed6b23d-kubelet-config\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433693 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-system-cni-dir\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433396 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-systemd-units\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433726 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-cni-bin\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433752 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-systemd\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433754 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-device-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433792 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-device-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433789 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-sys-fs\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.433848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433815 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cnibin\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433831 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433836 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-sys-fs\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433849 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88f9b\" (UniqueName: \"kubernetes.io/projected/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-kube-api-access-88f9b\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433865 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-cni-bin\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-k8s-cni-cncf-io\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433890 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-conf-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433908 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-log-socket\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433924 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433941 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433957 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433975 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-tmp-dir\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.433991 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-cni-multus\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434008 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-etc-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434038 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-cnibin\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434052 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-kubelet\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434066 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.434694 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434083 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-hosts-file\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434098 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927ef834-1155-464c-8f29-8c08c7988908-cni-binary-copy\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434115 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lslhw\" (UniqueName: \"kubernetes.io/projected/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-kube-api-access-lslhw\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434134 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-cni-netd\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434148 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c647f46c-9b00-443b-83b9-42d76ed6b23d-dbus\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434174 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-os-release\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434188 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-multus-certs\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434188 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-netns\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434203 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434234 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-etc-kubernetes\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434265 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434292 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-run-netns\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434326 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-run-ovn-kubernetes\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434380 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434406 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-registration-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434431 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-etc-selinux\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434465 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-hostroot\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.435506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434492 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-var-lib-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434517 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-socket-dir-parent\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434542 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-ovn\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434566 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434595 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-cni-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434619 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/927ef834-1155-464c-8f29-8c08c7988908-multus-daemon-config\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434645 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm4n8\" (UniqueName: \"kubernetes.io/projected/927ef834-1155-464c-8f29-8c08c7988908-kube-api-access-rm4n8\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434669 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-slash\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434703 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-node-log\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434726 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovnkube-script-lib\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434733 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.434752 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2dpk\" (UniqueName: \"kubernetes.io/projected/f3fd385d-fd3f-4275-b7de-520e63ca583e-kube-api-access-d2dpk\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435253 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovnkube-config\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-os-release\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435419 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-os-release\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435466 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c647f46c-9b00-443b-83b9-42d76ed6b23d-kubelet-config\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435503 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-cni-bin\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.436369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435547 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cnibin\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435589 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435758 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-socket-dir-parent\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435798 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-env-overrides\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435836 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-conf-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435877 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-kubelet\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.435993 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-hosts-file\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436007 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-run-netns\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436029 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-log-socket\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436049 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-run-ovn-kubernetes\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436087 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436123 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-registration-dir\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436200 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-etc-selinux\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436227 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-hostroot\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436253 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-var-lib-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436283 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-cni-bin\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436393 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.437129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436449 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-node-log\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436459 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-etc-openvswitch\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.436489 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436524 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-slash\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.436543 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret podName:c647f46c-9b00-443b-83b9-42d76ed6b23d nodeName:}" failed. No retries permitted until 2026-07-27 17:46:37.936529597 +0000 UTC m=+3.086656577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret") pod "global-pull-secret-syncer-cn72p" (UID: "c647f46c-9b00-443b-83b9-42d76ed6b23d") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436574 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-run-ovn\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436604 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-var-lib-cni-multus\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436578 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-multus-cni-dir\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436676 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-tmp-dir\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436691 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/927ef834-1155-464c-8f29-8c08c7988908-cni-binary-copy\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436528 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-cnibin\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436744 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c647f46c-9b00-443b-83b9-42d76ed6b23d-dbus\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436784 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-os-release\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436827 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436838 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/927ef834-1155-464c-8f29-8c08c7988908-host-run-multus-certs\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.436879 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3fd385d-fd3f-4275-b7de-520e63ca583e-host-cni-netd\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.437108 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovnkube-script-lib\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.437148 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.438006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.437486 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/927ef834-1155-464c-8f29-8c08c7988908-multus-daemon-config\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.439304 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.439280 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3fd385d-fd3f-4275-b7de-520e63ca583e-ovn-node-metrics-cert\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.442373 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.442298 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:46:37.442373 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.442320 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:46:37.442373 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.442332 2585 projected.go:196] Error preparing data for projected volume kube-api-access-52zk7 for pod openshift-network-diagnostics/network-check-target-hdpfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:37.442566 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.442406 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7 podName:190af8d8-eec3-4faa-89dc-0b26abc43221 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:37.942388657 +0000 UTC m=+3.092515661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-52zk7" (UniqueName: "kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7") pod "network-check-target-hdpfk" (UID: "190af8d8-eec3-4faa-89dc-0b26abc43221") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:37.444992 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.444943 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88f9b\" (UniqueName: \"kubernetes.io/projected/8c72460a-0686-4ef6-a5d4-29f408a9b0ce-kube-api-access-88f9b\") pod \"node-resolver-dk8ws\" (UID: \"8c72460a-0686-4ef6-a5d4-29f408a9b0ce\") " pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.445117 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.445057 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt477\" (UniqueName: \"kubernetes.io/projected/f1bb8239-4e05-4adb-917e-ceb9ca1a4814-kube-api-access-tt477\") pod \"aws-ebs-csi-driver-node-hg22p\" (UID: \"f1bb8239-4e05-4adb-917e-ceb9ca1a4814\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.445832 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.445807 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm4n8\" (UniqueName: \"kubernetes.io/projected/927ef834-1155-464c-8f29-8c08c7988908-kube-api-access-rm4n8\") pod \"multus-4z7sf\" (UID: \"927ef834-1155-464c-8f29-8c08c7988908\") " pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.447606 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.447580 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lslhw\" (UniqueName: \"kubernetes.io/projected/09e5958a-b65d-4dca-aa79-a8aa6542ba0b-kube-api-access-lslhw\") pod \"multus-additional-cni-plugins-wlpr7\" (UID: \"09e5958a-b65d-4dca-aa79-a8aa6542ba0b\") " pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.448010 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.447978 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2dpk\" (UniqueName: \"kubernetes.io/projected/f3fd385d-fd3f-4275-b7de-520e63ca583e-kube-api-access-d2dpk\") pod \"ovnkube-node-55xcz\" (UID: \"f3fd385d-fd3f-4275-b7de-520e63ca583e\") " pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.503836 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.503802 2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:46:37.520722 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.520682 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4rd4p" Jul 27 17:46:37.530243 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.530205 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rh4dx" Jul 27 17:46:37.541549 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.541517 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:46:37.547510 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.547479 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" Jul 27 17:46:37.556407 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.556381 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dk8ws" Jul 27 17:46:37.563231 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.563203 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4z7sf" Jul 27 17:46:37.573370 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.573234 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" Jul 27 17:46:37.582197 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.582168 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:46:37.595040 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.595015 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" Jul 27 17:46:37.838151 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.838060 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:37.838311 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.838235 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:37.838311 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.838302 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs podName:7fdc6818-a0a9-4b91-a91f-a077f73273f0 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:38.838284609 +0000 UTC m=+3.988411601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs") pod "network-metrics-daemon-xmb7v" (UID: "7fdc6818-a0a9-4b91-a91f-a077f73273f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:37.938885 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:37.938846 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:37.939042 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.939025 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:37.939122 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:37.939108 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret podName:c647f46c-9b00-443b-83b9-42d76ed6b23d nodeName:}" failed. No retries permitted until 2026-07-27 17:46:38.9390856 +0000 UTC m=+4.089212588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret") pod "global-pull-secret-syncer-cn72p" (UID: "c647f46c-9b00-443b-83b9-42d76ed6b23d") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:38.039244 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:38.039199 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:38.039428 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:38.039381 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:46:38.039428 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:38.039402 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:46:38.039428 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:38.039411 2585 projected.go:196] Error preparing data for projected volume kube-api-access-52zk7 for pod openshift-network-diagnostics/network-check-target-hdpfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:38.039553 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:38.039470 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7 podName:190af8d8-eec3-4faa-89dc-0b26abc43221 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:39.039451443 +0000 UTC m=+4.189578442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-52zk7" (UniqueName: "kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7") pod "network-check-target-hdpfk" (UID: "190af8d8-eec3-4faa-89dc-0b26abc43221") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:38.278558 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:38.278486 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:41:37 +0000 UTC" deadline="2028-03-10 16:34:09.58212023 +0000 UTC" Jul 27 17:46:38.278558 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:38.278550 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14206h47m31.303574222s" Jul 27 17:46:38.558667 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:38.558640 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c72460a_0686_4ef6_a5d4_29f408a9b0ce.slice/crio-11e32c70f1da750f92baf3913c7e56b80e4cbb22324a7737221c582493d4bdcb WatchSource:0}: Error finding container 11e32c70f1da750f92baf3913c7e56b80e4cbb22324a7737221c582493d4bdcb: Status 404 returned error can't find the container with id 11e32c70f1da750f92baf3913c7e56b80e4cbb22324a7737221c582493d4bdcb Jul 27 17:46:38.560851 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:38.560824 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b068a7_7e63_4ac8_b8a7_328304640f51.slice/crio-6c288757b3878c873e1293c3373a5a27a82d0c370d34880553c5985d805f06d5 WatchSource:0}: Error finding container 6c288757b3878c873e1293c3373a5a27a82d0c370d34880553c5985d805f06d5: Status 404 returned error can't find the container with id 6c288757b3878c873e1293c3373a5a27a82d0c370d34880553c5985d805f06d5 Jul 27 17:46:38.565937 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:38.565909 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3fd385d_fd3f_4275_b7de_520e63ca583e.slice/crio-84c2b7baefc8ac58f93cf6913749fde7f6dfef845614dce2c42b83927cc905ca WatchSource:0}: Error finding container 84c2b7baefc8ac58f93cf6913749fde7f6dfef845614dce2c42b83927cc905ca: Status 404 returned error can't find the container with id 84c2b7baefc8ac58f93cf6913749fde7f6dfef845614dce2c42b83927cc905ca Jul 27 17:46:38.567045 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:38.566828 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26973888_256a_4027_8636_d0a422085792.slice/crio-9b09fa07de3e244fffe09b13dc1009fc08880ffb9383d003743e0f7e87cabcaf WatchSource:0}: Error finding container 9b09fa07de3e244fffe09b13dc1009fc08880ffb9383d003743e0f7e87cabcaf: Status 404 returned error can't find the container with id 9b09fa07de3e244fffe09b13dc1009fc08880ffb9383d003743e0f7e87cabcaf Jul 27 17:46:38.567670 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:38.567620 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e5958a_b65d_4dca_aa79_a8aa6542ba0b.slice/crio-f6fd6c9c1b92cd0f9f6beeb91453486f135ed1e5bf642539edd60d525e9d251c WatchSource:0}: Error finding container f6fd6c9c1b92cd0f9f6beeb91453486f135ed1e5bf642539edd60d525e9d251c: Status 404 returned error can't find the container with id f6fd6c9c1b92cd0f9f6beeb91453486f135ed1e5bf642539edd60d525e9d251c Jul 27 17:46:38.569985 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:46:38.568828 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bb8239_4e05_4adb_917e_ceb9ca1a4814.slice/crio-cac514d3c8b01a82cf94c1f5633c903d9c62a438572f2f98f245dede491cb440 WatchSource:0}: Error finding container cac514d3c8b01a82cf94c1f5633c903d9c62a438572f2f98f245dede491cb440: Status 404 returned error can't find the container with id cac514d3c8b01a82cf94c1f5633c903d9c62a438572f2f98f245dede491cb440 Jul 27 17:46:38.845683 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:38.845293 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:38.845845 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:38.845561 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:38.845845 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:38.845826 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs podName:7fdc6818-a0a9-4b91-a91f-a077f73273f0 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:40.845793904 +0000 UTC m=+5.995920898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs") pod "network-metrics-daemon-xmb7v" (UID: "7fdc6818-a0a9-4b91-a91f-a077f73273f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:38.947062 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:38.947029 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:38.947291 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:38.947269 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:38.947414 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:38.947400 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret podName:c647f46c-9b00-443b-83b9-42d76ed6b23d nodeName:}" failed. No retries permitted until 2026-07-27 17:46:40.94736746 +0000 UTC m=+6.097494457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret") pod "global-pull-secret-syncer-cn72p" (UID: "c647f46c-9b00-443b-83b9-42d76ed6b23d") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:39.048293 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.048260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:39.048499 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:39.048477 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:46:39.048568 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:39.048507 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:46:39.048568 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:39.048521 2585 projected.go:196] Error preparing data for projected volume kube-api-access-52zk7 for pod openshift-network-diagnostics/network-check-target-hdpfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:39.048666 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:39.048583 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7 podName:190af8d8-eec3-4faa-89dc-0b26abc43221 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:41.04856364 +0000 UTC m=+6.198690635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-52zk7" (UniqueName: "kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7") pod "network-check-target-hdpfk" (UID: "190af8d8-eec3-4faa-89dc-0b26abc43221") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:39.279638 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.279500 2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:41:37 +0000 UTC" deadline="2028-01-20 08:51:14.471946122 +0000 UTC" Jul 27 17:46:39.279638 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.279554 2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12999h4m35.192395312s" Jul 27 17:46:39.399041 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.398231 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:39.399041 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:39.398372 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:39.399041 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.398741 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:39.399041 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:39.398842 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:39.399041 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.398906 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:39.399041 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:39.398988 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:39.409220 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.409151 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4rd4p" event={"ID":"59b068a7-7e63-4ac8-b8a7-328304640f51","Type":"ContainerStarted","Data":"6c288757b3878c873e1293c3373a5a27a82d0c370d34880553c5985d805f06d5"} Jul 27 17:46:39.411092 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.411015 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dk8ws" event={"ID":"8c72460a-0686-4ef6-a5d4-29f408a9b0ce","Type":"ContainerStarted","Data":"11e32c70f1da750f92baf3913c7e56b80e4cbb22324a7737221c582493d4bdcb"} Jul 27 17:46:39.414587 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.413663 2585 generic.go:356] "Generic (PLEG): container finished" podID="ae3551dcd8750d735f309652b0dd3b84" containerID="7930d416e8d7ae6e9f471a647f72aaba57fef168753620f4e00860a3166a548d" exitCode=0 Jul 27 17:46:39.414587 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.413738 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" event={"ID":"ae3551dcd8750d735f309652b0dd3b84","Type":"ContainerDied","Data":"7930d416e8d7ae6e9f471a647f72aaba57fef168753620f4e00860a3166a548d"} Jul 27 17:46:39.418126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.418076 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" event={"ID":"9ed7cbd15715a6bdb7dcea8103b7a8dc","Type":"ContainerStarted","Data":"2f8650856062e5af57d6a6055395727b3c8fd43b50d6ce9619d0980bc6c79177"} Jul 27 17:46:39.419759 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.419707 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42gjx" event={"ID":"41fa3362-3d22-4cd9-b5e6-cf1778ea8c02","Type":"ContainerStarted","Data":"69c1034dd647af54df551c7ed733b48cb5954fc9e8638d5abb457a475d411976"} Jul 27 17:46:39.422208 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.422181 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" event={"ID":"f1bb8239-4e05-4adb-917e-ceb9ca1a4814","Type":"ContainerStarted","Data":"cac514d3c8b01a82cf94c1f5633c903d9c62a438572f2f98f245dede491cb440"} Jul 27 17:46:39.426251 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.426226 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerStarted","Data":"f6fd6c9c1b92cd0f9f6beeb91453486f135ed1e5bf642539edd60d525e9d251c"} Jul 27 17:46:39.431358 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.431314 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" event={"ID":"26973888-256a-4027-8636-d0a422085792","Type":"ContainerStarted","Data":"9b09fa07de3e244fffe09b13dc1009fc08880ffb9383d003743e0f7e87cabcaf"} Jul 27 17:46:39.433245 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.433219 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rh4dx" event={"ID":"e80149e4-bbab-4642-9e5d-f79ddbf3a41b","Type":"ContainerStarted","Data":"366950c9d72727ab1cbe762c19556cf04c67a8da7e9667b9b52d11e76542eba3"} Jul 27 17:46:39.440816 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.440754 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4z7sf" event={"ID":"927ef834-1155-464c-8f29-8c08c7988908","Type":"ContainerStarted","Data":"c2cae5bfa87a214fd52d6e0c030449b596da01775546aedbd456c27afa0a4200"} Jul 27 17:46:39.442934 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.442870 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-79.ec2.internal" podStartSLOduration=3.442851832 podStartE2EDuration="3.442851832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:46:39.442569483 +0000 UTC m=+4.592696484" watchObservedRunningTime="2026-07-27 17:46:39.442851832 +0000 UTC m=+4.592978835" Jul 27 17:46:39.446486 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:39.446446 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"84c2b7baefc8ac58f93cf6913749fde7f6dfef845614dce2c42b83927cc905ca"} Jul 27 17:46:40.467532 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:40.467411 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" event={"ID":"ae3551dcd8750d735f309652b0dd3b84","Type":"ContainerStarted","Data":"57bbc9deab3aa8ed433de3c054def0ad5766cde741832480b788d299525b5341"} Jul 27 17:46:40.865818 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:40.865728 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:40.866027 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:40.865944 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:40.866027 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:40.866016 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs podName:7fdc6818-a0a9-4b91-a91f-a077f73273f0 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:44.865994688 +0000 UTC m=+10.016121671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs") pod "network-metrics-daemon-xmb7v" (UID: "7fdc6818-a0a9-4b91-a91f-a077f73273f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:40.966677 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:40.966596 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:40.966929 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:40.966889 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:40.967000 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:40.966973 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret podName:c647f46c-9b00-443b-83b9-42d76ed6b23d nodeName:}" failed. No retries permitted until 2026-07-27 17:46:44.966954008 +0000 UTC m=+10.117081007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret") pod "global-pull-secret-syncer-cn72p" (UID: "c647f46c-9b00-443b-83b9-42d76ed6b23d") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:41.067880 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:41.067747 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:41.068051 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:41.067904 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:46:41.068051 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:41.067931 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:46:41.068051 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:41.067945 2585 projected.go:196] Error preparing data for projected volume kube-api-access-52zk7 for pod openshift-network-diagnostics/network-check-target-hdpfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:41.068051 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:41.068009 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7 podName:190af8d8-eec3-4faa-89dc-0b26abc43221 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:45.067990712 +0000 UTC m=+10.218117695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-52zk7" (UniqueName: "kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7") pod "network-check-target-hdpfk" (UID: "190af8d8-eec3-4faa-89dc-0b26abc43221") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:41.399174 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:41.399136 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:41.399373 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:41.399311 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:41.399803 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:41.399780 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:41.399908 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:41.399883 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:41.399967 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:41.399931 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:41.400060 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:41.400026 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:43.398218 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:43.398182 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:43.398688 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:43.398353 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:43.398770 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:43.398756 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:43.398868 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:43.398827 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:43.398927 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:43.398869 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:43.398927 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:43.398911 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:44.899545 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:44.899506 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:44.900019 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:44.899688 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:44.900019 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:44.899862 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs podName:7fdc6818-a0a9-4b91-a91f-a077f73273f0 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:52.89977241 +0000 UTC m=+18.049899404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs") pod "network-metrics-daemon-xmb7v" (UID: "7fdc6818-a0a9-4b91-a91f-a077f73273f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:45.000307 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:45.000250 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:45.000507 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.000433 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:45.000565 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.000510 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret podName:c647f46c-9b00-443b-83b9-42d76ed6b23d nodeName:}" failed. No retries permitted until 2026-07-27 17:46:53.000491414 +0000 UTC m=+18.150618411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret") pod "global-pull-secret-syncer-cn72p" (UID: "c647f46c-9b00-443b-83b9-42d76ed6b23d") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:45.101212 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:45.101168 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:45.101397 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.101380 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:46:45.101477 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.101399 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:46:45.101477 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.101415 2585 projected.go:196] Error preparing data for projected volume kube-api-access-52zk7 for pod openshift-network-diagnostics/network-check-target-hdpfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:45.101574 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.101480 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7 podName:190af8d8-eec3-4faa-89dc-0b26abc43221 nodeName:}" failed. No retries permitted until 2026-07-27 17:46:53.10145956 +0000 UTC m=+18.251586544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-52zk7" (UniqueName: "kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7") pod "network-check-target-hdpfk" (UID: "190af8d8-eec3-4faa-89dc-0b26abc43221") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:45.397319 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:45.397232 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:45.397489 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.397322 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:45.397756 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:45.397718 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:45.397849 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.397829 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:45.397996 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:45.397980 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:45.398992 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:45.398930 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:47.396940 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:47.396441 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:47.396940 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:47.396441 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:47.396940 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:47.396591 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:47.396940 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:47.396595 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:47.396940 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:47.396682 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:47.396940 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:47.396759 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:49.396458 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:49.396370 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:49.396874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:49.396375 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:49.396874 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:49.396510 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:49.396874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:49.396375 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:49.396874 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:49.396604 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:49.396874 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:49.396780 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:51.396728 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:51.396257 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:51.396728 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:51.396406 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:51.396728 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:51.396409 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:51.396728 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:51.396530 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:51.396728 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:51.396414 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:51.396728 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:51.396644 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:52.962958 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:52.962923 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:52.963355 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:52.963070 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:52.963355 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:52.963135 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs podName:7fdc6818-a0a9-4b91-a91f-a077f73273f0 nodeName:}" failed. No retries permitted until 2026-07-27 17:47:08.963117336 +0000 UTC m=+34.113244315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs") pod "network-metrics-daemon-xmb7v" (UID: "7fdc6818-a0a9-4b91-a91f-a077f73273f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:46:53.064294 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:53.064248 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:53.064507 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.064409 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:53.064507 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.064479 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret podName:c647f46c-9b00-443b-83b9-42d76ed6b23d nodeName:}" failed. No retries permitted until 2026-07-27 17:47:09.064462867 +0000 UTC m=+34.214589851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret") pod "global-pull-secret-syncer-cn72p" (UID: "c647f46c-9b00-443b-83b9-42d76ed6b23d") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:46:53.165044 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:53.165001 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:53.165220 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.165192 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:46:53.165277 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.165223 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:46:53.165277 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.165238 2585 projected.go:196] Error preparing data for projected volume kube-api-access-52zk7 for pod openshift-network-diagnostics/network-check-target-hdpfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:53.165434 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.165287 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7 podName:190af8d8-eec3-4faa-89dc-0b26abc43221 nodeName:}" failed. No retries permitted until 2026-07-27 17:47:09.165274008 +0000 UTC m=+34.315400987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-52zk7" (UniqueName: "kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7") pod "network-check-target-hdpfk" (UID: "190af8d8-eec3-4faa-89dc-0b26abc43221") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:46:53.397054 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:53.396589 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:53.397054 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:53.396589 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:53.397054 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.396725 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:53.397054 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:53.396588 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:53.397054 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.396803 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:53.397054 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:53.396881 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:55.397160 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:55.397122 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:55.397648 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:55.397242 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:55.397648 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:55.397267 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:55.397648 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:55.397247 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:55.397648 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:55.397387 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:55.397648 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:55.397454 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:57.396905 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.396656 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:57.397574 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:57.396986 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:57.397574 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.396721 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:57.397574 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:57.397073 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:46:57.397574 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.396669 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:57.397574 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:57.397163 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:57.506390 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.506357 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" event={"ID":"26973888-256a-4027-8636-d0a422085792","Type":"ContainerStarted","Data":"f5851059d13104c6986f414c5b633a51272880e8957c23f5e4217d46091e43aa"} Jul 27 17:46:57.508074 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.507955 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4z7sf" event={"ID":"927ef834-1155-464c-8f29-8c08c7988908","Type":"ContainerStarted","Data":"1ac1aa7f11dbf6d942de7e713ef799cc68fc04e01ec0abcd8010a01577ba9477"} Jul 27 17:46:57.509642 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.509612 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"ee72b73c8c7dfe71350c2381805b5ea5e0985c4aa67576e9452334d3d23a6248"} Jul 27 17:46:57.511273 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.511171 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4rd4p" event={"ID":"59b068a7-7e63-4ac8-b8a7-328304640f51","Type":"ContainerStarted","Data":"d086ac7875c4282548abcaf0ccc264ef75f70f35767529519d70c87de0825d68"} Jul 27 17:46:57.514111 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.513595 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dk8ws" event={"ID":"8c72460a-0686-4ef6-a5d4-29f408a9b0ce","Type":"ContainerStarted","Data":"a87fc7dbe46b30494b1a9b167c5c0c2ed01fd31356af97b5ab202f5a816149fa"} Jul 27 17:46:57.515532 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.515511 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42gjx" event={"ID":"41fa3362-3d22-4cd9-b5e6-cf1778ea8c02","Type":"ContainerStarted","Data":"7f44d1b09ed38e6bb1d41b5822f4af86e2620f7253ac381ec0e80a037544f337"} Jul 27 17:46:57.516985 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.516965 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" event={"ID":"f1bb8239-4e05-4adb-917e-ceb9ca1a4814","Type":"ContainerStarted","Data":"ad52e74ea49893e5446d1b0a1fd942eb53f048104a0457a14d3868ae9a3ea1e0"} Jul 27 17:46:57.518154 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.518136 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerStarted","Data":"5636cb63cfa5f2ce9bc533547f430bec6a22f3c2f30118ff78c6f36e11058244"} Jul 27 17:46:57.525905 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.525861 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-79.ec2.internal" podStartSLOduration=21.525848014 podStartE2EDuration="21.525848014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:46:40.490980701 +0000 UTC m=+5.641107704" watchObservedRunningTime="2026-07-27 17:46:57.525848014 +0000 UTC m=+22.675975016" Jul 27 17:46:57.526495 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.526467 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hgz6z" podStartSLOduration=3.957919697 podStartE2EDuration="22.526459403s" totalImagesPullingTime="18.568539706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:46:57.525666041 +0000 UTC m=+22.675793047" watchObservedRunningTime="2026-07-27 17:46:57.526459403 +0000 UTC m=+22.676586404" Jul 27 17:46:57.544369 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.544297 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4z7sf" podStartSLOduration=3.930793278 podStartE2EDuration="22.544281623s" totalImagesPullingTime="18.613488345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:46:57.543694851 +0000 UTC m=+22.693821867" watchObservedRunningTime="2026-07-27 17:46:57.544281623 +0000 UTC m=+22.694408625" Jul 27 17:46:57.600365 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.600300 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-42gjx" podStartSLOduration=4.037775078 podStartE2EDuration="22.600284039s" totalImagesPullingTime="18.562508961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:46:57.58439156 +0000 UTC m=+22.734518563" watchObservedRunningTime="2026-07-27 17:46:57.600284039 +0000 UTC m=+22.750411040" Jul 27 17:46:57.600545 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.600516 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dk8ws" podStartSLOduration=8.186378357 podStartE2EDuration="22.600504591s" totalImagesPullingTime="14.414126234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:46:57.600082123 +0000 UTC m=+22.750209134" watchObservedRunningTime="2026-07-27 17:46:57.600504591 +0000 UTC m=+22.750631595" Jul 27 17:46:57.621595 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.621542 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4rd4p" podStartSLOduration=4.065857595 podStartE2EDuration="22.621523872s" totalImagesPullingTime="18.555666277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:46:57.616818839 +0000 UTC m=+22.766945842" watchObservedRunningTime="2026-07-27 17:46:57.621523872 +0000 UTC m=+22.771650875" Jul 27 17:46:57.643223 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:57.643190 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:46:58.522061 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.521874 2585 generic.go:356] "Generic (PLEG): container finished" podID="09e5958a-b65d-4dca-aa79-a8aa6542ba0b" containerID="5636cb63cfa5f2ce9bc533547f430bec6a22f3c2f30118ff78c6f36e11058244" exitCode=0 Jul 27 17:46:58.522676 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.521911 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerDied","Data":"5636cb63cfa5f2ce9bc533547f430bec6a22f3c2f30118ff78c6f36e11058244"} Jul 27 17:46:58.523670 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.523643 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rh4dx" event={"ID":"e80149e4-bbab-4642-9e5d-f79ddbf3a41b","Type":"ContainerStarted","Data":"45157b5d9885e45fb755c216c5f6c3ad2def454a9aa4127367eea923f117992f"} Jul 27 17:46:58.526435 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.526418 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-acl-logging/0.log" Jul 27 17:46:58.526752 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.526729 2585 generic.go:356] "Generic (PLEG): container finished" podID="f3fd385d-fd3f-4275-b7de-520e63ca583e" containerID="f068a0c975353af05b2565e1ae1bdad04cbe01a6a26aed6e2777c5262de581c8" exitCode=1 Jul 27 17:46:58.526849 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.526824 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"cec87ee20315ad7ed7a1918032a154f5687dd23f40a279077a2b5c41004e8975"} Jul 27 17:46:58.526905 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.526886 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"ecdb741b2f7ce41cc0681ea7806906131197ec349f32ba295d1cbd23eab58013"} Jul 27 17:46:58.526973 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.526920 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"660ef177bff3bae2164f4ea37cceb40d15b0b185388548223ed0682ffd6e05fe"} Jul 27 17:46:58.526973 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.526947 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"e979e6629d0d0df1f5847ce87c88927ea4d78854e47643081158cfbdab63041e"} Jul 27 17:46:58.527078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.526976 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerDied","Data":"f068a0c975353af05b2565e1ae1bdad04cbe01a6a26aed6e2777c5262de581c8"} Jul 27 17:46:58.558198 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:58.558151 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rh4dx" podStartSLOduration=9.15032884 podStartE2EDuration="23.558136176s" totalImagesPullingTime="14.407807336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:46:58.558050497 +0000 UTC m=+23.708177499" watchObservedRunningTime="2026-07-27 17:46:58.558136176 +0000 UTC m=+23.708263177" Jul 27 17:46:59.396998 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:59.396963 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:46:59.396998 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:59.396998 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:46:59.397260 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:46:59.396963 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:46:59.397260 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:59.397108 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:46:59.397260 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:59.397168 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:46:59.397389 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:46:59.397267 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:47:00.388509 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:00.388479 2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 17:47:00.534150 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:00.534114 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" event={"ID":"f1bb8239-4e05-4adb-917e-ceb9ca1a4814","Type":"ContainerStarted","Data":"b0724a7069246e510cd72424e3d011910f6bc9ad411d02445e485f8f0bf000ae"} Jul 27 17:47:00.537703 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:00.537680 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-acl-logging/0.log" Jul 27 17:47:00.538086 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:00.538061 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"7e868d7932743af0a8618584562a72d3400fa96b4b9a725b2729c525d505fc81"} Jul 27 17:47:01.296820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:01.296506 2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T17:47:00.388503329Z","UUID":"f0c10d86-955f-4b78-adce-3ee4ffaf1f04","Handler":null,"Name":"","Endpoint":""} Jul 27 17:47:01.298056 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:01.298024 2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 17:47:01.298184 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:01.298074 2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 17:47:01.396497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:01.396464 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:01.396497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:01.396502 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:01.396989 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:01.396464 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:01.396989 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:01.396600 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:47:01.396989 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:01.396686 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:47:01.396989 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:01.396783 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:47:01.849423 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:01.849387 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:47:01.850064 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:01.850041 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:47:02.056798 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:02.056741 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:02.148755 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:02.148647 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:02.543288 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:02.543210 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:47:02.543752 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:02.543730 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-42gjx" Jul 27 17:47:03.396799 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.396607 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:03.396983 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.396607 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:03.396983 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:03.396885 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:47:03.396983 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.396662 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:03.396983 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:03.396945 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:47:03.397185 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:03.397004 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:47:03.548165 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.548138 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-acl-logging/0.log" Jul 27 17:47:03.548856 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.548544 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"677a21ae4efda8cfb5c9976d5029d7c4cd9dabeb8f8e68f40348282582203354"} Jul 27 17:47:03.548856 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.548754 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:47:03.548988 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.548970 2585 scope.go:117] "RemoveContainer" containerID="f068a0c975353af05b2565e1ae1bdad04cbe01a6a26aed6e2777c5262de581c8" Jul 27 17:47:03.550946 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.550917 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" event={"ID":"f1bb8239-4e05-4adb-917e-ceb9ca1a4814","Type":"ContainerStarted","Data":"1aa772974e98248c09901210d9b1e24bd2bd9de34ae5ddc0a9a3a0dde8d20f29"} Jul 27 17:47:03.552892 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.552864 2585 generic.go:356] "Generic (PLEG): container finished" podID="09e5958a-b65d-4dca-aa79-a8aa6542ba0b" containerID="1840440958a760f0d1faab3903b9b4c31359d911d22cf8764ba7b60bf0fc9c02" exitCode=0 Jul 27 17:47:03.553002 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.552931 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerDied","Data":"1840440958a760f0d1faab3903b9b4c31359d911d22cf8764ba7b60bf0fc9c02"} Jul 27 17:47:03.566185 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.566161 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:47:03.636225 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:03.636174 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hg22p" podStartSLOduration=4.109246324 podStartE2EDuration="28.636156479s" totalImagesPullingTime="24.526910155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:03.63604355 +0000 UTC m=+28.786170552" watchObservedRunningTime="2026-07-27 17:47:03.636156479 +0000 UTC m=+28.786283481" Jul 27 17:47:04.400583 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.400546 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:04.502733 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.502707 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:04.557632 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.557603 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerStarted","Data":"144fe82076078e50081bb69bd42cbd35b0f0cd5ad3d3f4241e252cfee8a3ffb6"} Jul 27 17:47:04.561809 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.561687 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-acl-logging/0.log" Jul 27 17:47:04.562105 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.562080 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" event={"ID":"f3fd385d-fd3f-4275-b7de-520e63ca583e","Type":"ContainerStarted","Data":"90c461f44fd8872de0411d44e3f1ead165a3e7cb0c22cb70565255bf7c3b15f2"} Jul 27 17:47:04.562626 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.562590 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:47:04.562742 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.562724 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:47:04.578370 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.578327 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:47:04.588135 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.588110 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:04.609968 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.609921 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" podStartSLOduration=11.004075951 podStartE2EDuration="29.609904442s" totalImagesPullingTime="18.605828491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:04.609172745 +0000 UTC m=+29.759299746" watchObservedRunningTime="2026-07-27 17:47:04.609904442 +0000 UTC m=+29.760031444" Jul 27 17:47:04.706004 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.705916 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:04.802682 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:04.802653 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:05.397517 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.397489 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:05.397676 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:05.397604 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:47:05.397676 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.397660 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:05.397781 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.397735 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:05.397867 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:05.397843 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:47:05.397983 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:05.397954 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:47:05.566512 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.566235 2585 generic.go:356] "Generic (PLEG): container finished" podID="09e5958a-b65d-4dca-aa79-a8aa6542ba0b" containerID="144fe82076078e50081bb69bd42cbd35b0f0cd5ad3d3f4241e252cfee8a3ffb6" exitCode=0 Jul 27 17:47:05.566865 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.566334 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerDied","Data":"144fe82076078e50081bb69bd42cbd35b0f0cd5ad3d3f4241e252cfee8a3ffb6"} Jul 27 17:47:05.664122 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.664050 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hdpfk"] Jul 27 17:47:05.664275 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.664204 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:05.664334 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:05.664318 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:47:05.667311 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.667278 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cn72p"] Jul 27 17:47:05.667462 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.667433 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:05.667557 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:05.667536 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:47:05.668050 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.668029 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmb7v"] Jul 27 17:47:05.668153 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:05.668135 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:05.668280 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:05.668237 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:47:06.571104 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:06.571064 2585 generic.go:356] "Generic (PLEG): container finished" podID="09e5958a-b65d-4dca-aa79-a8aa6542ba0b" containerID="5f5d24efc08ddbb9419779ee87d2311023706ae739b3dd58f57719cf5cc0eb92" exitCode=0 Jul 27 17:47:06.571680 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:06.571132 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerDied","Data":"5f5d24efc08ddbb9419779ee87d2311023706ae739b3dd58f57719cf5cc0eb92"} Jul 27 17:47:07.396167 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:07.396131 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:07.396367 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:07.396131 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:07.396367 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:07.396271 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:47:07.396367 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:07.396132 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:07.396542 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:07.396314 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:47:07.396542 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:07.396478 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:47:08.983690 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:08.983650 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:08.984276 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:08.983802 2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:47:08.984276 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:08.983872 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs podName:7fdc6818-a0a9-4b91-a91f-a077f73273f0 nodeName:}" failed. No retries permitted until 2026-07-27 17:47:40.983853954 +0000 UTC m=+66.133980936 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs") pod "network-metrics-daemon-xmb7v" (UID: "7fdc6818-a0a9-4b91-a91f-a077f73273f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:47:09.084958 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.084920 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:09.085158 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.085058 2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:47:09.085158 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.085130 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret podName:c647f46c-9b00-443b-83b9-42d76ed6b23d nodeName:}" failed. No retries permitted until 2026-07-27 17:47:41.085108542 +0000 UTC m=+66.235235539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret") pod "global-pull-secret-syncer-cn72p" (UID: "c647f46c-9b00-443b-83b9-42d76ed6b23d") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:47:09.185398 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.185362 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:09.185623 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.185474 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:47:09.185623 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.185495 2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:47:09.185623 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.185505 2585 projected.go:196] Error preparing data for projected volume kube-api-access-52zk7 for pod openshift-network-diagnostics/network-check-target-hdpfk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:47:09.185623 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.185560 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7 podName:190af8d8-eec3-4faa-89dc-0b26abc43221 nodeName:}" failed. No retries permitted until 2026-07-27 17:47:41.185540628 +0000 UTC m=+66.335667629 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-52zk7" (UniqueName: "kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7") pod "network-check-target-hdpfk" (UID: "190af8d8-eec3-4faa-89dc-0b26abc43221") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:47:09.396808 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.396772 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:09.397059 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.396772 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:09.397059 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.396896 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdpfk" podUID="190af8d8-eec3-4faa-89dc-0b26abc43221" Jul 27 17:47:09.397059 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.396907 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:09.397059 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.397015 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmb7v" podUID="7fdc6818-a0a9-4b91-a91f-a077f73273f0" Jul 27 17:47:09.397275 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:09.397149 2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cn72p" podUID="c647f46c-9b00-443b-83b9-42d76ed6b23d" Jul 27 17:47:09.472476 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.472436 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:09.572901 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.572866 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:09.660438 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.660362 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:09.823319 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.823283 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:09.923521 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:09.923425 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.024973 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.024933 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.086313 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.086280 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.151689 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.151655 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.194937 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.194851 2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-79.ec2.internal" event="NodeReady" Jul 27 17:47:10.195115 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.195015 2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 17:47:10.249355 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.249316 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hmsqh"] Jul 27 17:47:10.269653 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.269625 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f7b6z"] Jul 27 17:47:10.269822 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.269752 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmsqh" Jul 27 17:47:10.273103 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.273075 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 17:47:10.273249 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.273094 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 17:47:10.273249 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.273075 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 17:47:10.273529 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.273492 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dtz76\"" Jul 27 17:47:10.283794 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.283768 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmsqh"] Jul 27 17:47:10.283909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.283801 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f7b6z"] Jul 27 17:47:10.283909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.283903 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.288565 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.288127 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 17:47:10.288565 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.288144 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 17:47:10.288565 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.288280 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d7g7h\"" Jul 27 17:47:10.288565 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.288436 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 17:47:10.288956 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.288936 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 17:47:10.337497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.337418 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.347566 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.347537 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-88xth"] Jul 27 17:47:10.363763 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.363736 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.364418 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.364333 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-88xth"] Jul 27 17:47:10.366537 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.366495 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 17:47:10.366739 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.366724 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 17:47:10.366931 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.366896 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vgp2z\"" Jul 27 17:47:10.392078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.392035 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71dac001-885d-41e5-a8b4-63c6dee5d673-data-volume\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.392257 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.392088 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71dac001-885d-41e5-a8b4-63c6dee5d673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.392257 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.392117 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9e6286a-567a-4956-bb69-675ae72d9898-cert\") pod \"ingress-canary-hmsqh\" (UID: \"d9e6286a-567a-4956-bb69-675ae72d9898\") " pod="openshift-ingress-canary/ingress-canary-hmsqh" Jul 27 17:47:10.392257 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.392153 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71dac001-885d-41e5-a8b4-63c6dee5d673-crio-socket\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.392257 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.392187 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5hxr\" (UniqueName: \"kubernetes.io/projected/d9e6286a-567a-4956-bb69-675ae72d9898-kube-api-access-j5hxr\") pod \"ingress-canary-hmsqh\" (UID: \"d9e6286a-567a-4956-bb69-675ae72d9898\") " pod="openshift-ingress-canary/ingress-canary-hmsqh" Jul 27 17:47:10.392257 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.392213 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f4db\" (UniqueName: \"kubernetes.io/projected/71dac001-885d-41e5-a8b4-63c6dee5d673-kube-api-access-5f4db\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.392257 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.392232 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71dac001-885d-41e5-a8b4-63c6dee5d673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.493522 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493439 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71dac001-885d-41e5-a8b4-63c6dee5d673-data-volume\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.493522 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493485 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f415abf-1a5d-479c-a2f1-65e937dbebd6-tmp-dir\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.493522 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493516 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71dac001-885d-41e5-a8b4-63c6dee5d673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.493825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493539 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9e6286a-567a-4956-bb69-675ae72d9898-cert\") pod \"ingress-canary-hmsqh\" (UID: \"d9e6286a-567a-4956-bb69-675ae72d9898\") " pod="openshift-ingress-canary/ingress-canary-hmsqh" Jul 27 17:47:10.493825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493574 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71dac001-885d-41e5-a8b4-63c6dee5d673-crio-socket\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.493825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493596 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kn28\" (UniqueName: \"kubernetes.io/projected/9f415abf-1a5d-479c-a2f1-65e937dbebd6-kube-api-access-8kn28\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.493825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493628 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hxr\" (UniqueName: \"kubernetes.io/projected/d9e6286a-567a-4956-bb69-675ae72d9898-kube-api-access-j5hxr\") pod \"ingress-canary-hmsqh\" (UID: \"d9e6286a-567a-4956-bb69-675ae72d9898\") " pod="openshift-ingress-canary/ingress-canary-hmsqh" Jul 27 17:47:10.493825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493663 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f4db\" (UniqueName: \"kubernetes.io/projected/71dac001-885d-41e5-a8b4-63c6dee5d673-kube-api-access-5f4db\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.493825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493689 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f415abf-1a5d-479c-a2f1-65e937dbebd6-config-volume\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.493825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493714 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71dac001-885d-41e5-a8b4-63c6dee5d673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.493825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493777 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f415abf-1a5d-479c-a2f1-65e937dbebd6-metrics-tls\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.494204 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.493882 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71dac001-885d-41e5-a8b4-63c6dee5d673-data-volume\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.494452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.494428 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71dac001-885d-41e5-a8b4-63c6dee5d673-crio-socket\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.494786 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.494761 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71dac001-885d-41e5-a8b4-63c6dee5d673-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.498189 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.498168 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71dac001-885d-41e5-a8b4-63c6dee5d673-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.498296 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.498220 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9e6286a-567a-4956-bb69-675ae72d9898-cert\") pod \"ingress-canary-hmsqh\" (UID: \"d9e6286a-567a-4956-bb69-675ae72d9898\") " pod="openshift-ingress-canary/ingress-canary-hmsqh" Jul 27 17:47:10.503107 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.503087 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f4db\" (UniqueName: \"kubernetes.io/projected/71dac001-885d-41e5-a8b4-63c6dee5d673-kube-api-access-5f4db\") pod \"insights-runtime-extractor-f7b6z\" (UID: \"71dac001-885d-41e5-a8b4-63c6dee5d673\") " pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.503222 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.503124 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5hxr\" (UniqueName: \"kubernetes.io/projected/d9e6286a-567a-4956-bb69-675ae72d9898-kube-api-access-j5hxr\") pod \"ingress-canary-hmsqh\" (UID: \"d9e6286a-567a-4956-bb69-675ae72d9898\") " pod="openshift-ingress-canary/ingress-canary-hmsqh" Jul 27 17:47:10.519210 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.519179 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.581461 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.581437 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hmsqh" Jul 27 17:47:10.593620 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.593595 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f7b6z" Jul 27 17:47:10.594780 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.594760 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f415abf-1a5d-479c-a2f1-65e937dbebd6-config-volume\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.594834 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.594809 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f415abf-1a5d-479c-a2f1-65e937dbebd6-metrics-tls\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.594869 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.594846 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f415abf-1a5d-479c-a2f1-65e937dbebd6-tmp-dir\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.594906 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.594882 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kn28\" (UniqueName: \"kubernetes.io/projected/9f415abf-1a5d-479c-a2f1-65e937dbebd6-kube-api-access-8kn28\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.595195 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.595168 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f415abf-1a5d-479c-a2f1-65e937dbebd6-tmp-dir\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.595299 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.595284 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f415abf-1a5d-479c-a2f1-65e937dbebd6-config-volume\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.597384 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.597366 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f415abf-1a5d-479c-a2f1-65e937dbebd6-metrics-tls\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.604403 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.604372 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kn28\" (UniqueName: \"kubernetes.io/projected/9f415abf-1a5d-479c-a2f1-65e937dbebd6-kube-api-access-8kn28\") pod \"dns-default-88xth\" (UID: \"9f415abf-1a5d-479c-a2f1-65e937dbebd6\") " pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.622267 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.622241 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.674725 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.674675 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88xth" Jul 27 17:47:10.721802 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.721547 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.781956 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.781926 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:10.809055 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.809025 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hmsqh"] Jul 27 17:47:10.814789 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.814763 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f7b6z"] Jul 27 17:47:10.834937 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:10.834906 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-88xth"] Jul 27 17:47:10.871445 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:10.869765 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e6286a_567a_4956_bb69_675ae72d9898.slice/crio-c869865e3853da805f1a5e6946d61061391016ea4c166e0a9ce3a321a8f0db4f WatchSource:0}: Error finding container c869865e3853da805f1a5e6946d61061391016ea4c166e0a9ce3a321a8f0db4f: Status 404 returned error can't find the container with id c869865e3853da805f1a5e6946d61061391016ea4c166e0a9ce3a321a8f0db4f Jul 27 17:47:10.871445 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:10.870395 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dac001_885d_41e5_a8b4_63c6dee5d673.slice/crio-ecd447fce214fa23240bd0df1719ff91ee8c34930d447fdf3d12b10fcaa487fd WatchSource:0}: Error finding container ecd447fce214fa23240bd0df1719ff91ee8c34930d447fdf3d12b10fcaa487fd: Status 404 returned error can't find the container with id ecd447fce214fa23240bd0df1719ff91ee8c34930d447fdf3d12b10fcaa487fd Jul 27 17:47:10.871762 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:10.871679 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f415abf_1a5d_479c_a2f1_65e937dbebd6.slice/crio-041f824f454857a4d112e68c781dd62520db13a44e93d701fda1b0aad2bda515 WatchSource:0}: Error finding container 041f824f454857a4d112e68c781dd62520db13a44e93d701fda1b0aad2bda515: Status 404 returned error can't find the container with id 041f824f454857a4d112e68c781dd62520db13a44e93d701fda1b0aad2bda515 Jul 27 17:47:11.396810 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.396777 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:11.397373 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.396777 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:11.397373 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.396776 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:11.400287 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.400252 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 17:47:11.400287 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.400286 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l9688\"" Jul 27 17:47:11.400527 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.400401 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 17:47:11.400527 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.400291 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b7fvg\"" Jul 27 17:47:11.400629 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.400619 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 17:47:11.400686 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.400628 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 17:47:11.584600 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.584560 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88xth" event={"ID":"9f415abf-1a5d-479c-a2f1-65e937dbebd6","Type":"ContainerStarted","Data":"041f824f454857a4d112e68c781dd62520db13a44e93d701fda1b0aad2bda515"} Jul 27 17:47:11.587271 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.587229 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmsqh" event={"ID":"d9e6286a-567a-4956-bb69-675ae72d9898","Type":"ContainerStarted","Data":"c869865e3853da805f1a5e6946d61061391016ea4c166e0a9ce3a321a8f0db4f"} Jul 27 17:47:11.588843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.588813 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7b6z" event={"ID":"71dac001-885d-41e5-a8b4-63c6dee5d673","Type":"ContainerStarted","Data":"ecd447fce214fa23240bd0df1719ff91ee8c34930d447fdf3d12b10fcaa487fd"} Jul 27 17:47:11.593171 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.593142 2585 generic.go:356] "Generic (PLEG): container finished" podID="09e5958a-b65d-4dca-aa79-a8aa6542ba0b" containerID="d655f52212e39ac4e7b47400b4ed0f5a99e7444f486bc3e1c65c76fbcd617e9c" exitCode=0 Jul 27 17:47:11.593293 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:11.593189 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerDied","Data":"d655f52212e39ac4e7b47400b4ed0f5a99e7444f486bc3e1c65c76fbcd617e9c"} Jul 27 17:47:12.569527 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:12.569461 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:12.601295 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:12.601257 2585 generic.go:356] "Generic (PLEG): container finished" podID="09e5958a-b65d-4dca-aa79-a8aa6542ba0b" containerID="6429be704bed116afec69ad438855824479106effc4b9c364f64f08f42ae9d9b" exitCode=0 Jul 27 17:47:12.601496 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:12.601360 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerDied","Data":"6429be704bed116afec69ad438855824479106effc4b9c364f64f08f42ae9d9b"} Jul 27 17:47:12.628330 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:12.628257 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:13.544678 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:13.544638 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:13.603396 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:13.603365 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:13.609215 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:13.609149 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" event={"ID":"09e5958a-b65d-4dca-aa79-a8aa6542ba0b","Type":"ContainerStarted","Data":"5b6a7b969079bc7988bb0edca7526cdebe43fae4e49675c0ca661cd3c497cd55"} Jul 27 17:47:13.788690 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:13.788656 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:13.845263 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:13.845224 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:13.903123 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:13.903083 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:14.556124 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.556063 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wlpr7" podStartSLOduration=10.846760911 podStartE2EDuration="39.556045215s" totalImagesPullingTime="28.709284304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:13.640665512 +0000 UTC m=+38.790792514" watchObservedRunningTime="2026-07-27 17:47:14.556045215 +0000 UTC m=+39.706172280" Jul 27 17:47:14.556635 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.556614 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cc9b568d5-r7lxz"] Jul 27 17:47:14.614777 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.614744 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc9b568d5-r7lxz"] Jul 27 17:47:14.615194 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.614874 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.617582 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.617562 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 17:47:14.617739 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.617685 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 17:47:14.617925 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.617906 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-22tgt\"" Jul 27 17:47:14.618013 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.617933 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 17:47:14.618013 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.617936 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 17:47:14.618513 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.618496 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 17:47:14.618604 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.618565 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 17:47:14.618673 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.618645 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 17:47:14.727132 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.727089 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-console-config\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.727132 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.727136 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5767d\" (UniqueName: \"kubernetes.io/projected/9e93e8f0-9684-404e-8d9b-49d399b07466-kube-api-access-5767d\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.727392 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.727325 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-serving-cert\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.727392 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.727393 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-oauth-config\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.727518 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.727446 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-service-ca\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.727518 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.727471 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-oauth-serving-cert\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.828641 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.828548 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-console-config\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.828641 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.828601 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5767d\" (UniqueName: \"kubernetes.io/projected/9e93e8f0-9684-404e-8d9b-49d399b07466-kube-api-access-5767d\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.828867 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.828717 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-serving-cert\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.828867 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.828748 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-oauth-config\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.828867 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.828801 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-service-ca\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.828867 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.828829 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-oauth-serving-cert\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.829595 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.829565 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-oauth-serving-cert\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.829595 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.829586 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-console-config\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.829824 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.829586 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-service-ca\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.833679 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.833652 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-oauth-config\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.836826 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.836802 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-serving-cert\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.837405 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.837385 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5767d\" (UniqueName: \"kubernetes.io/projected/9e93e8f0-9684-404e-8d9b-49d399b07466-kube-api-access-5767d\") pod \"console-6cc9b568d5-r7lxz\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:14.926448 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:14.926410 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:15.083112 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:15.083032 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:15.144147 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:15.144113 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:15.646047 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:15.646005 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:15.745405 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:15.745368 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:17.350324 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:17.350287 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:17.452580 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:17.452542 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:17.902979 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:17.902947 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cc9b568d5-r7lxz"] Jul 27 17:47:17.905975 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:17.905949 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e93e8f0_9684_404e_8d9b_49d399b07466.slice/crio-9619b6cc2c31b51f0ea5cc74ba493a83b44b02b9ab25be176f0eaefc829416a7 WatchSource:0}: Error finding container 9619b6cc2c31b51f0ea5cc74ba493a83b44b02b9ab25be176f0eaefc829416a7: Status 404 returned error can't find the container with id 9619b6cc2c31b51f0ea5cc74ba493a83b44b02b9ab25be176f0eaefc829416a7 Jul 27 17:47:18.624776 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:18.624739 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hmsqh" event={"ID":"d9e6286a-567a-4956-bb69-675ae72d9898","Type":"ContainerStarted","Data":"e2f19460d4c38d27ac8a6f61178ee7983034cac01e50b4eee4062abf4cc41bbf"} Jul 27 17:47:18.626472 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:18.626446 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9b568d5-r7lxz" event={"ID":"9e93e8f0-9684-404e-8d9b-49d399b07466","Type":"ContainerStarted","Data":"9619b6cc2c31b51f0ea5cc74ba493a83b44b02b9ab25be176f0eaefc829416a7"} Jul 27 17:47:18.628603 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:18.628268 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88xth" event={"ID":"9f415abf-1a5d-479c-a2f1-65e937dbebd6","Type":"ContainerStarted","Data":"88024a6bf6845d6c9b7087cbf9694ce4bc352cb35ba999b30b5f084a8d73a859"} Jul 27 17:47:18.628603 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:18.628328 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88xth" event={"ID":"9f415abf-1a5d-479c-a2f1-65e937dbebd6","Type":"ContainerStarted","Data":"5b3084123f6bd8b2972b7f7e83c2b6a7e868aa5c94a832425eff3251be2550cd"} Jul 27 17:47:18.628603 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:18.628385 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-88xth" Jul 27 17:47:18.629881 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:18.629862 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7b6z" event={"ID":"71dac001-885d-41e5-a8b4-63c6dee5d673","Type":"ContainerStarted","Data":"45e49d3372f925ec01128c6d2e6154961509d680e2085511186d7717f8849718"} Jul 27 17:47:18.642265 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:18.642209 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hmsqh" podStartSLOduration=1.755232238 podStartE2EDuration="8.642193396s" totalImagesPullingTime="6.886961158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:18.641086453 +0000 UTC m=+43.791213456" watchObservedRunningTime="2026-07-27 17:47:18.642193396 +0000 UTC m=+43.792320376" Jul 27 17:47:18.658475 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:18.658416 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-88xth" podStartSLOduration=1.769828161 podStartE2EDuration="8.658398534s" totalImagesPullingTime="6.888570373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:18.658194318 +0000 UTC m=+43.808321321" watchObservedRunningTime="2026-07-27 17:47:18.658398534 +0000 UTC m=+43.808525537" Jul 27 17:47:19.672013 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.671945 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:19.714195 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.714162 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-r8grc"] Jul 27 17:47:19.728603 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.728573 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-r8grc"] Jul 27 17:47:19.728776 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.728700 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.732715 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.732452 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 27 17:47:19.732715 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.732569 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nlqhd\"" Jul 27 17:47:19.732715 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.732590 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 17:47:19.732715 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.732622 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 27 17:47:19.732954 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.732724 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 17:47:19.733293 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.733269 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 17:47:19.751404 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.751378 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:19.872266 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.872225 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.872476 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.872277 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs8xd\" (UniqueName: \"kubernetes.io/projected/9796a2a8-a78f-462a-ae75-3348615f50ee-kube-api-access-qs8xd\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.872476 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.872424 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.872591 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.872495 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9796a2a8-a78f-462a-ae75-3348615f50ee-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.973237 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.973147 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.973237 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.973212 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9796a2a8-a78f-462a-ae75-3348615f50ee-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.973459 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.973296 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.973459 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:19.973320 2585 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 27 17:47:19.973459 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:19.973410 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-tls podName:9796a2a8-a78f-462a-ae75-3348615f50ee nodeName:}" failed. No retries permitted until 2026-07-27 17:47:20.473391913 +0000 UTC m=+45.623518893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-r8grc" (UID: "9796a2a8-a78f-462a-ae75-3348615f50ee") : secret "prometheus-operator-tls" not found Jul 27 17:47:19.973559 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.973325 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs8xd\" (UniqueName: \"kubernetes.io/projected/9796a2a8-a78f-462a-ae75-3348615f50ee-kube-api-access-qs8xd\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.974408 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.974358 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9796a2a8-a78f-462a-ae75-3348615f50ee-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.976873 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.976847 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:19.982357 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:19.982316 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs8xd\" (UniqueName: \"kubernetes.io/projected/9796a2a8-a78f-462a-ae75-3348615f50ee-kube-api-access-qs8xd\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:20.054355 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:20.054277 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:20.478097 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:20.478063 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:20.480907 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:20.480885 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9796a2a8-a78f-462a-ae75-3348615f50ee-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-r8grc\" (UID: \"9796a2a8-a78f-462a-ae75-3348615f50ee\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:20.645422 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:20.645390 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" Jul 27 17:47:21.561785 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.561746 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c949fc57b-nvvzc"] Jul 27 17:47:21.568787 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.568754 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:21.660627 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.660587 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:21.710170 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.710131 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c949fc57b-nvvzc"] Jul 27 17:47:21.710326 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.710230 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.718325 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.718300 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 17:47:21.890439 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.890358 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-config\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.890439 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.890419 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8krrs\" (UniqueName: \"kubernetes.io/projected/646cf84a-bd2a-4f06-821b-67ebc92b31df-kube-api-access-8krrs\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.890617 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.890484 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-service-ca\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.890617 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.890517 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-serving-cert\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.890617 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.890535 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-oauth-config\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.890617 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.890557 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-trusted-ca-bundle\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.890617 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.890587 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-oauth-serving-cert\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.991508 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.991467 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8krrs\" (UniqueName: \"kubernetes.io/projected/646cf84a-bd2a-4f06-821b-67ebc92b31df-kube-api-access-8krrs\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.991676 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.991518 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-service-ca\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.991728 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.991677 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-serving-cert\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.991728 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.991711 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-oauth-config\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.991799 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.991746 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-trusted-ca-bundle\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.991799 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.991793 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-oauth-serving-cert\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.991869 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.991837 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-config\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.992333 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.992295 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-service-ca\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.992625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.992529 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-config\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.993373 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.993325 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-trusted-ca-bundle\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.993475 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.993405 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-oauth-serving-cert\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.994844 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.994819 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-oauth-config\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.994939 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.994926 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-serving-cert\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:21.999762 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:21.999742 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8krrs\" (UniqueName: \"kubernetes.io/projected/646cf84a-bd2a-4f06-821b-67ebc92b31df-kube-api-access-8krrs\") pod \"console-7c949fc57b-nvvzc\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:22.019785 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:22.019745 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:23.821523 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:23.821484 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:23.876093 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:23.876063 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:24.201585 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.200206 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-r8grc"] Jul 27 17:47:24.216619 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.216586 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c949fc57b-nvvzc"] Jul 27 17:47:24.313282 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:24.313242 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9796a2a8_a78f_462a_ae75_3348615f50ee.slice/crio-1cd1a5674278a041af8ad10193af4f24d9d98c5dc25054110ee91e1075fc67de WatchSource:0}: Error finding container 1cd1a5674278a041af8ad10193af4f24d9d98c5dc25054110ee91e1075fc67de: Status 404 returned error can't find the container with id 1cd1a5674278a041af8ad10193af4f24d9d98c5dc25054110ee91e1075fc67de Jul 27 17:47:24.313768 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:24.313740 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646cf84a_bd2a_4f06_821b_67ebc92b31df.slice/crio-d85ad7fe65179e30eba507ed5f656453b5e5dee7b961bfd5f8e1ead7a4af7403 WatchSource:0}: Error finding container d85ad7fe65179e30eba507ed5f656453b5e5dee7b961bfd5f8e1ead7a4af7403: Status 404 returned error can't find the container with id d85ad7fe65179e30eba507ed5f656453b5e5dee7b961bfd5f8e1ead7a4af7403 Jul 27 17:47:24.650298 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.650202 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7b6z" event={"ID":"71dac001-885d-41e5-a8b4-63c6dee5d673","Type":"ContainerStarted","Data":"d59521c9385a4e749407522aa56cb577224f3df23a9e69b125bd5244029dfa1e"} Jul 27 17:47:24.651700 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.651668 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9b568d5-r7lxz" event={"ID":"9e93e8f0-9684-404e-8d9b-49d399b07466","Type":"ContainerStarted","Data":"3b15b60365d9059fb7d6b92cb618e5c00f04f412ef7c4e5eb0e2d61d5730f7fc"} Jul 27 17:47:24.653173 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.653150 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c949fc57b-nvvzc" event={"ID":"646cf84a-bd2a-4f06-821b-67ebc92b31df","Type":"ContainerStarted","Data":"9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53"} Jul 27 17:47:24.653287 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.653192 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c949fc57b-nvvzc" event={"ID":"646cf84a-bd2a-4f06-821b-67ebc92b31df","Type":"ContainerStarted","Data":"d85ad7fe65179e30eba507ed5f656453b5e5dee7b961bfd5f8e1ead7a4af7403"} Jul 27 17:47:24.654264 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.654246 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" event={"ID":"9796a2a8-a78f-462a-ae75-3348615f50ee","Type":"ContainerStarted","Data":"1cd1a5674278a041af8ad10193af4f24d9d98c5dc25054110ee91e1075fc67de"} Jul 27 17:47:24.670036 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.669991 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cc9b568d5-r7lxz" podStartSLOduration=4.504558907 podStartE2EDuration="10.669976222s" totalImagesPullingTime="6.165417315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:24.669724724 +0000 UTC m=+49.819851726" watchObservedRunningTime="2026-07-27 17:47:24.669976222 +0000 UTC m=+49.820103225" Jul 27 17:47:24.690799 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.690742 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c949fc57b-nvvzc" podStartSLOduration=3.690722325 podStartE2EDuration="3.690722325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:24.689730104 +0000 UTC m=+49.839857108" watchObservedRunningTime="2026-07-27 17:47:24.690722325 +0000 UTC m=+49.840849327" Jul 27 17:47:24.927561 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.927476 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:24.927561 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.927556 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:24.933139 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:24.933106 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:25.052730 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:25.052669 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:25.109740 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:25.109669 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:25.665450 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:25.665410 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:26.666789 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:26.666746 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" event={"ID":"9796a2a8-a78f-462a-ae75-3348615f50ee","Type":"ContainerStarted","Data":"740c08c9345feb9b27f2f79037e116cdbb8fc66ba6e92beea62ff7679ba76e8b"} Jul 27 17:47:26.667248 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:26.666816 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" event={"ID":"9796a2a8-a78f-462a-ae75-3348615f50ee","Type":"ContainerStarted","Data":"2c3021613f206991c0ad7b9bf934a43dd5a72e12698b8ee8e67d2450fc63e90d"} Jul 27 17:47:26.685629 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:26.685566 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-r8grc" podStartSLOduration=6.003681758 podStartE2EDuration="7.685542419s" totalImagesPullingTime="1.681860661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:26.684956485 +0000 UTC m=+51.835083488" watchObservedRunningTime="2026-07-27 17:47:26.685542419 +0000 UTC m=+51.835669419" Jul 27 17:47:27.350499 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:27.350462 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:27.446630 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:27.446578 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:28.635493 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:28.635462 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-88xth" Jul 27 17:47:28.676167 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:28.676133 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f7b6z" event={"ID":"71dac001-885d-41e5-a8b4-63c6dee5d673","Type":"ContainerStarted","Data":"b26130e646948960e3a5fa238b1d9aba20034ffd07b445668af4f85535b7cfc4"} Jul 27 17:47:28.695851 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:28.695799 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f7b6z" podStartSLOduration=1.316677303 podStartE2EDuration="18.695782507s" totalImagesPullingTime="17.379105204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:47:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:28.694884921 +0000 UTC m=+53.845011923" watchObservedRunningTime="2026-07-27 17:47:28.695782507 +0000 UTC m=+53.845909508" Jul 27 17:47:28.781797 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:28.781720 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:28.878026 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:28.877989 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:29.384931 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:29.384893 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:30.343239 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:30.343200 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:30.402884 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:30.402858 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:32.020689 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:32.020648 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:32.021081 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:32.020730 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:32.025265 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:32.025242 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:32.693894 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:32.693866 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:47:32.737309 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:32.737273 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc9b568d5-r7lxz"] Jul 27 17:47:33.166291 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.166256 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:33.274450 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.274418 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:33.283530 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.283455 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw"] Jul 27 17:47:33.285552 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.285537 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.289103 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.289083 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 27 17:47:33.289231 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.289185 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-m58ld\"" Jul 27 17:47:33.289231 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.289192 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 27 17:47:33.291858 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.291839 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjjkd\" (UniqueName: \"kubernetes.io/projected/c51caf32-86e6-46f3-9427-0adcc1b01cec-kube-api-access-vjjkd\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.291950 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.291879 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c51caf32-86e6-46f3-9427-0adcc1b01cec-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.291950 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.291918 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.292030 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.292018 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.303005 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.302981 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw"] Jul 27 17:47:33.310534 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.310511 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q"] Jul 27 17:47:33.312452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.312431 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.314114 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.314092 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-djjww"] Jul 27 17:47:33.315375 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.315358 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 27 17:47:33.315712 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.315694 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 27 17:47:33.316102 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.316088 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.316592 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.316558 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jpnsl\"" Jul 27 17:47:33.316690 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.316599 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 27 17:47:33.318227 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.318210 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 17:47:33.318331 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.318320 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 17:47:33.318499 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.318465 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xwzxk\"" Jul 27 17:47:33.318499 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.318491 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 17:47:33.325972 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.325949 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q"] Jul 27 17:47:33.392869 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.392830 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c51caf32-86e6-46f3-9427-0adcc1b01cec-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.392869 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.392873 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvp9w\" (UniqueName: \"kubernetes.io/projected/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-api-access-nvp9w\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.393077 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.392903 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.393077 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.392933 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg9bf\" (UniqueName: \"kubernetes.io/projected/944f00e9-208e-412a-9d83-086aac74f68d-kube-api-access-wg9bf\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.393077 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393034 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-accelerators-collector-config\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.393217 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393079 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.393217 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393114 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.393217 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393143 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.393217 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393172 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.393217 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:33.393192 2585 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 27 17:47:33.393217 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393204 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-root\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.393551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393238 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-tls\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.393551 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:33.393264 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls podName:c51caf32-86e6-46f3-9427-0adcc1b01cec nodeName:}" failed. No retries permitted until 2026-07-27 17:47:33.893243012 +0000 UTC m=+59.043370011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-q88lw" (UID: "c51caf32-86e6-46f3-9427-0adcc1b01cec") : secret "openshift-state-metrics-tls" not found Jul 27 17:47:33.393551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393322 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-wtmp\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.393551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393396 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-textfile\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.393551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393443 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.393551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393493 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.393551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393522 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.393551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393532 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c51caf32-86e6-46f3-9427-0adcc1b01cec-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.393855 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393569 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjjkd\" (UniqueName: \"kubernetes.io/projected/c51caf32-86e6-46f3-9427-0adcc1b01cec-kube-api-access-vjjkd\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.393855 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-sys\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.393855 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.393627 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/944f00e9-208e-412a-9d83-086aac74f68d-metrics-client-ca\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.395482 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.395462 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.406027 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.406007 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjjkd\" (UniqueName: \"kubernetes.io/projected/c51caf32-86e6-46f3-9427-0adcc1b01cec-kube-api-access-vjjkd\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.433162 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.433091 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:33.494123 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494089 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg9bf\" (UniqueName: \"kubernetes.io/projected/944f00e9-208e-412a-9d83-086aac74f68d-kube-api-access-wg9bf\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494138 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-accelerators-collector-config\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494169 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494187 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494204 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494220 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-root\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494238 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-tls\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494282 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-wtmp\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:33.494295 2585 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 27 17:47:33.494312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494308 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-textfile\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.494777 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494326 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-root\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.494777 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:33.494459 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-tls podName:4aa08fdc-2c37-4137-a8c1-2c5bba73ae51 nodeName:}" failed. No retries permitted until 2026-07-27 17:47:33.994437265 +0000 UTC m=+59.144564265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-vdg9q" (UID: "4aa08fdc-2c37-4137-a8c1-2c5bba73ae51") : secret "kube-state-metrics-tls" not found Jul 27 17:47:33.494777 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494492 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-wtmp\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.494777 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494654 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.494777 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494675 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.494777 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494766 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.495078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494802 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.495078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494848 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-textfile\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.495078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494860 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-sys\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.495078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494874 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-accelerators-collector-config\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.495078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494890 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/944f00e9-208e-412a-9d83-086aac74f68d-metrics-client-ca\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.495078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.494957 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvp9w\" (UniqueName: \"kubernetes.io/projected/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-api-access-nvp9w\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.495078 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.495052 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.495473 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.495119 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/944f00e9-208e-412a-9d83-086aac74f68d-sys\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.495473 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.495384 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/944f00e9-208e-412a-9d83-086aac74f68d-metrics-client-ca\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.495596 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.495475 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.496963 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.496942 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-tls\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.497608 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.497584 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/944f00e9-208e-412a-9d83-086aac74f68d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.497773 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.497748 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.502589 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.502547 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg9bf\" (UniqueName: \"kubernetes.io/projected/944f00e9-208e-412a-9d83-086aac74f68d-kube-api-access-wg9bf\") pod \"node-exporter-djjww\" (UID: \"944f00e9-208e-412a-9d83-086aac74f68d\") " pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.502918 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.502900 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvp9w\" (UniqueName: \"kubernetes.io/projected/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-api-access-nvp9w\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:33.542170 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.542136 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:33.627714 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.627682 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-djjww" Jul 27 17:47:33.634449 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.634422 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:33.637782 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:33.637760 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944f00e9_208e_412a_9d83_086aac74f68d.slice/crio-4cfb9a719e32d3feb75e56d02216505a646780fe075d4c63e7ef2bd72dc8e667 WatchSource:0}: Error finding container 4cfb9a719e32d3feb75e56d02216505a646780fe075d4c63e7ef2bd72dc8e667: Status 404 returned error can't find the container with id 4cfb9a719e32d3feb75e56d02216505a646780fe075d4c63e7ef2bd72dc8e667 Jul 27 17:47:33.696471 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.696382 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djjww" event={"ID":"944f00e9-208e-412a-9d83-086aac74f68d","Type":"ContainerStarted","Data":"4cfb9a719e32d3feb75e56d02216505a646780fe075d4c63e7ef2bd72dc8e667"} Jul 27 17:47:33.734542 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.734506 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:33.898628 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.898585 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:33.898799 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:33.898739 2585 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 27 17:47:33.898840 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:33.898818 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls podName:c51caf32-86e6-46f3-9427-0adcc1b01cec nodeName:}" failed. No retries permitted until 2026-07-27 17:47:34.898802059 +0000 UTC m=+60.048929039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-q88lw" (UID: "c51caf32-86e6-46f3-9427-0adcc1b01cec") : secret "openshift-state-metrics-tls" not found Jul 27 17:47:33.955133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.955049 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:33.999484 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:33.999441 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:34.001970 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.001947 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4aa08fdc-2c37-4137-a8c1-2c5bba73ae51-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-vdg9q\" (UID: \"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:34.059316 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.059277 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:34.222781 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.222698 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" Jul 27 17:47:34.323740 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.323688 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:34.375746 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.375724 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q"] Jul 27 17:47:34.378034 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:34.378004 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa08fdc_2c37_4137_a8c1_2c5bba73ae51.slice/crio-4f6b5c7eb865fac01a8db06b9c1a6dd16d3fad3437b13d43ff3bde1c82e354c8 WatchSource:0}: Error finding container 4f6b5c7eb865fac01a8db06b9c1a6dd16d3fad3437b13d43ff3bde1c82e354c8: Status 404 returned error can't find the container with id 4f6b5c7eb865fac01a8db06b9c1a6dd16d3fad3437b13d43ff3bde1c82e354c8 Jul 27 17:47:34.426458 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.426326 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:34.467506 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.467473 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 17:47:34.473783 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.473708 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.476769 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.476742 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 17:47:34.476911 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.476767 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 17:47:34.476911 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.476787 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 17:47:34.477208 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.477186 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 17:47:34.477208 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.477185 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 17:47:34.477361 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.477246 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 17:47:34.477361 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.477278 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x9l2z\"" Jul 27 17:47:34.477537 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.477516 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 17:47:34.477650 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.477558 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 17:47:34.477714 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.477673 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 17:47:34.491052 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.491026 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 17:47:34.502808 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.502743 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:34.503127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503104 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-web-config\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503199 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503146 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503199 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503173 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9kc\" (UniqueName: \"kubernetes.io/projected/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-kube-api-access-xn9kc\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503272 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503215 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503272 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503244 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503361 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503286 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503361 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503314 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503361 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503334 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503539 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503409 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-config-volume\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503539 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503424 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503539 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503441 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-config-out\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503655 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503582 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.503655 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.503604 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604233 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604198 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-web-config\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604453 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604240 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604453 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604261 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9kc\" (UniqueName: \"kubernetes.io/projected/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-kube-api-access-xn9kc\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604453 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604281 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604453 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604375 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604668 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604456 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604668 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604484 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604668 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604513 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604668 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:34.604598 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-trusted-ca-bundle podName:c4b79c11-917e-4c13-bf1c-ac3d8236ee19 nodeName:}" failed. No retries permitted until 2026-07-27 17:47:35.104575267 +0000 UTC m=+60.254702247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c4b79c11-917e-4c13-bf1c-ac3d8236ee19") : configmap references non-existent config key: ca-bundle.crt Jul 27 17:47:34.604668 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604625 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-config-volume\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604668 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604654 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604947 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604682 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-config-out\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604947 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604741 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.604947 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.604777 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.606052 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:34.605667 2585 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 27 17:47:34.606052 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:34.605733 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-main-tls podName:c4b79c11-917e-4c13-bf1c-ac3d8236ee19 nodeName:}" failed. No retries permitted until 2026-07-27 17:47:35.10571633 +0000 UTC m=+60.255843310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c4b79c11-917e-4c13-bf1c-ac3d8236ee19") : secret "alertmanager-main-tls" not found Jul 27 17:47:34.606052 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.605736 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.606052 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.605991 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.607820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.607756 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-web-config\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.607820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.607762 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.608105 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.607996 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-config-out\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.608154 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.608128 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.608256 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.608233 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.608477 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.608461 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.608805 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.608789 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-config-volume\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.609487 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.609465 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.612984 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.612961 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9kc\" (UniqueName: \"kubernetes.io/projected/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-kube-api-access-xn9kc\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:34.701204 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.701168 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" event={"ID":"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51","Type":"ContainerStarted","Data":"4f6b5c7eb865fac01a8db06b9c1a6dd16d3fad3437b13d43ff3bde1c82e354c8"} Jul 27 17:47:34.839822 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.839789 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:34.907160 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.907112 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:34.909674 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:34.909649 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c51caf32-86e6-46f3-9427-0adcc1b01cec-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-q88lw\" (UID: \"c51caf32-86e6-46f3-9427-0adcc1b01cec\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:35.094049 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.094027 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" Jul 27 17:47:35.108524 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.108496 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:35.108656 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.108576 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:35.109305 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.109284 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:35.110898 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.110875 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c4b79c11-917e-4c13-bf1c-ac3d8236ee19-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c4b79c11-917e-4c13-bf1c-ac3d8236ee19\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:35.263098 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.263047 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw"] Jul 27 17:47:35.265707 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:35.265679 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51caf32_86e6_46f3_9427_0adcc1b01cec.slice/crio-9fa38ff5e578b87962baf0a35680975c120192683ec025f38a338316bf1386cf WatchSource:0}: Error finding container 9fa38ff5e578b87962baf0a35680975c120192683ec025f38a338316bf1386cf: Status 404 returned error can't find the container with id 9fa38ff5e578b87962baf0a35680975c120192683ec025f38a338316bf1386cf Jul 27 17:47:35.390211 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.390185 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x9l2z\"" Jul 27 17:47:35.390887 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.390858 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69dd89c97d-r6ct8"] Jul 27 17:47:35.394067 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.394047 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.396584 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.396565 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 27 17:47:35.397142 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.397036 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 27 17:47:35.397142 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.397076 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f5ut1arc4jbi1\"" Jul 27 17:47:35.397142 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.397108 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 27 17:47:35.397296 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.397227 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 17:47:35.397659 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.397426 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bjlj2\"" Jul 27 17:47:35.397659 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.397497 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 27 17:47:35.397659 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.397625 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 27 17:47:35.410285 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.410260 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69dd89c97d-r6ct8"] Jul 27 17:47:35.414234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.413283 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.414234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.413323 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-grpc-tls\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.414234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.413396 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-metrics-client-ca\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.414234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.413446 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.414234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.413516 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.414234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.413545 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcb6m\" (UniqueName: \"kubernetes.io/projected/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-kube-api-access-vcb6m\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.414234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.413588 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.414234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.413616 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-tls\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.514619 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.514586 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.514619 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.514624 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-tls\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.514810 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.514666 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.514810 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.514684 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-grpc-tls\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.514810 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.514712 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-metrics-client-ca\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.514810 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.514759 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.515004 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.514828 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.515004 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.514859 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcb6m\" (UniqueName: \"kubernetes.io/projected/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-kube-api-access-vcb6m\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.516399 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.516373 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-metrics-client-ca\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.517705 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.517655 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.518053 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.518028 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.518106 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.518073 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.518436 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.518415 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-tls\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.518664 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.518645 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-grpc-tls\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.518722 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.518709 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.523091 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.523066 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcb6m\" (UniqueName: \"kubernetes.io/projected/c99ef2d2-2bdf-45a7-a406-cdd788d9addc-kube-api-access-vcb6m\") pod \"thanos-querier-69dd89c97d-r6ct8\" (UID: \"c99ef2d2-2bdf-45a7-a406-cdd788d9addc\") " pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.555610 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.555587 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 17:47:35.557620 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:35.557593 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b79c11_917e_4c13_bf1c_ac3d8236ee19.slice/crio-a40067612841621048c1f535f507ccb2fbfc20e611c181852558defe0f8e5a04 WatchSource:0}: Error finding container a40067612841621048c1f535f507ccb2fbfc20e611c181852558defe0f8e5a04: Status 404 returned error can't find the container with id a40067612841621048c1f535f507ccb2fbfc20e611c181852558defe0f8e5a04 Jul 27 17:47:35.557993 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.557966 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:35.658333 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.658240 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:35.705964 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.705926 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4b79c11-917e-4c13-bf1c-ac3d8236ee19","Type":"ContainerStarted","Data":"a40067612841621048c1f535f507ccb2fbfc20e611c181852558defe0f8e5a04"} Jul 27 17:47:35.707636 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.707608 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" event={"ID":"c51caf32-86e6-46f3-9427-0adcc1b01cec","Type":"ContainerStarted","Data":"d2049f6c886fe3862a66e58f86c8c52577e5cc139d2319293ac0ed4c16ce308f"} Jul 27 17:47:35.707765 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.707655 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" event={"ID":"c51caf32-86e6-46f3-9427-0adcc1b01cec","Type":"ContainerStarted","Data":"d32ee3a0f5916ea7bde7092aef48bfa39847190920231631a5a3df79753c0e10"} Jul 27 17:47:35.707765 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.707673 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" event={"ID":"c51caf32-86e6-46f3-9427-0adcc1b01cec","Type":"ContainerStarted","Data":"9fa38ff5e578b87962baf0a35680975c120192683ec025f38a338316bf1386cf"} Jul 27 17:47:35.709044 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.709017 2585 generic.go:356] "Generic (PLEG): container finished" podID="944f00e9-208e-412a-9d83-086aac74f68d" containerID="3bcff376f275bb92ec0a1a4f94d2c123503f06258d019e9d19103554828f0478" exitCode=0 Jul 27 17:47:35.709114 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.709054 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djjww" event={"ID":"944f00e9-208e-412a-9d83-086aac74f68d","Type":"ContainerDied","Data":"3bcff376f275bb92ec0a1a4f94d2c123503f06258d019e9d19103554828f0478"} Jul 27 17:47:35.735453 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.735398 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:35.888822 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:35.888784 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69dd89c97d-r6ct8"] Jul 27 17:47:35.892916 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:35.892889 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99ef2d2_2bdf_45a7_a406_cdd788d9addc.slice/crio-46c46251e01781254f825c4945129a25a0aa90cc11304ce5829260bc98f5fa05 WatchSource:0}: Error finding container 46c46251e01781254f825c4945129a25a0aa90cc11304ce5829260bc98f5fa05: Status 404 returned error can't find the container with id 46c46251e01781254f825c4945129a25a0aa90cc11304ce5829260bc98f5fa05 Jul 27 17:47:36.335682 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.335637 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:36.390981 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.390943 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:36.585144 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.585115 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-55xcz" Jul 27 17:47:36.706382 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.706266 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:36.715947 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.715916 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djjww" event={"ID":"944f00e9-208e-412a-9d83-086aac74f68d","Type":"ContainerStarted","Data":"48e8e7411f68f242d729f585ddcbfb0f16e0c3491ab273ea2c6b054423db3008"} Jul 27 17:47:36.716100 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.716009 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-djjww" event={"ID":"944f00e9-208e-412a-9d83-086aac74f68d","Type":"ContainerStarted","Data":"d50195cd9f65eb86defe4b5a1f12929003266cb96b142727aee6efdec3a6f286"} Jul 27 17:47:36.716991 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.716969 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" event={"ID":"c99ef2d2-2bdf-45a7-a406-cdd788d9addc","Type":"ContainerStarted","Data":"46c46251e01781254f825c4945129a25a0aa90cc11304ce5829260bc98f5fa05"} Jul 27 17:47:36.735882 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.735815 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-djjww" podStartSLOduration=2.24561877 podStartE2EDuration="3.735795s" totalImagesPullingTime="1.385115776s" totalInitContainerRuntime="105.060454ms" isStatefulPod=true podCreationTimestamp="2026-07-27 17:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:36.734203654 +0000 UTC m=+61.884330671" watchObservedRunningTime="2026-07-27 17:47:36.735795 +0000 UTC m=+61.885922003" Jul 27 17:47:36.806984 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.806947 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:36.914403 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:36.914302 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:37.012602 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.012526 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:37.608703 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.608676 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55744fd7cc-sn5ff"] Jul 27 17:47:37.611418 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.611401 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.614236 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.614215 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qks8v\"" Jul 27 17:47:37.614333 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.614281 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 27 17:47:37.614333 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.614281 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 27 17:47:37.614489 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.614333 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 17:47:37.614489 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.614290 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-78l5t7e8i0474\"" Jul 27 17:47:37.614489 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.614288 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 27 17:47:37.622857 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.622828 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55744fd7cc-sn5ff"] Jul 27 17:47:37.636818 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.636717 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-secret-metrics-server-client-certs\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.636818 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.636775 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c286d71-546c-421e-bf23-61c51b2041ee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.637097 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.636833 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-secret-metrics-server-tls\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.637097 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.636962 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmrzf\" (UniqueName: \"kubernetes.io/projected/8c286d71-546c-421e-bf23-61c51b2041ee-kube-api-access-nmrzf\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.637097 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.637015 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-client-ca-bundle\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.637097 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.637062 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c286d71-546c-421e-bf23-61c51b2041ee-audit-log\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.637097 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.637089 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c286d71-546c-421e-bf23-61c51b2041ee-metrics-server-audit-profiles\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.723930 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.723844 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" event={"ID":"c51caf32-86e6-46f3-9427-0adcc1b01cec","Type":"ContainerStarted","Data":"a80999901e7c06fbdb6a4294171c0f03748d9ba0f08a346986847c62fd002c69"} Jul 27 17:47:37.726254 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.726219 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" event={"ID":"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51","Type":"ContainerStarted","Data":"733142741f781c81b84a9f9d2d5fda6e793efcb03e012f50a0cbe9028a568abd"} Jul 27 17:47:37.726430 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.726285 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" event={"ID":"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51","Type":"ContainerStarted","Data":"b324e79331304c48b0a2d6427f683a1e1d9da9f1fe92924da21b4d5f4946bf71"} Jul 27 17:47:37.726430 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.726313 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" event={"ID":"4aa08fdc-2c37-4137-a8c1-2c5bba73ae51","Type":"ContainerStarted","Data":"4c48cfaf20c850c03fa8930e0b577b3f704660c0bca1cde899d72353cb8f3857"} Jul 27 17:47:37.727955 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.727910 2585 generic.go:356] "Generic (PLEG): container finished" podID="c4b79c11-917e-4c13-bf1c-ac3d8236ee19" containerID="4b5454be8eb140be811c13bbbf363a8ba7e1dce473eafe59ea12cc4cd59eb5a9" exitCode=0 Jul 27 17:47:37.728068 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.727948 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4b79c11-917e-4c13-bf1c-ac3d8236ee19","Type":"ContainerDied","Data":"4b5454be8eb140be811c13bbbf363a8ba7e1dce473eafe59ea12cc4cd59eb5a9"} Jul 27 17:47:37.738396 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.738365 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmrzf\" (UniqueName: \"kubernetes.io/projected/8c286d71-546c-421e-bf23-61c51b2041ee-kube-api-access-nmrzf\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.738518 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.738423 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-client-ca-bundle\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.738518 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.738467 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c286d71-546c-421e-bf23-61c51b2041ee-audit-log\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.738518 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.738495 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c286d71-546c-421e-bf23-61c51b2041ee-metrics-server-audit-profiles\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.738674 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.738531 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-secret-metrics-server-client-certs\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.738674 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.738571 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c286d71-546c-421e-bf23-61c51b2041ee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.738674 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.738625 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-secret-metrics-server-tls\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.738958 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.738894 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c286d71-546c-421e-bf23-61c51b2041ee-audit-log\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.739729 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.739700 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c286d71-546c-421e-bf23-61c51b2041ee-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.739932 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.739909 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c286d71-546c-421e-bf23-61c51b2041ee-metrics-server-audit-profiles\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.741528 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.741413 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-secret-metrics-server-client-certs\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.742229 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.742204 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-secret-metrics-server-tls\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.742574 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.742548 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c286d71-546c-421e-bf23-61c51b2041ee-client-ca-bundle\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.743314 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.743269 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-q88lw" podStartSLOduration=2.645655496 podStartE2EDuration="4.743257084s" totalImagesPullingTime="2.097601588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:37.741542431 +0000 UTC m=+62.891669459" watchObservedRunningTime="2026-07-27 17:47:37.743257084 +0000 UTC m=+62.893384085" Jul 27 17:47:37.751451 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.751426 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmrzf\" (UniqueName: \"kubernetes.io/projected/8c286d71-546c-421e-bf23-61c51b2041ee-kube-api-access-nmrzf\") pod \"metrics-server-55744fd7cc-sn5ff\" (UID: \"8c286d71-546c-421e-bf23-61c51b2041ee\") " pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:37.787429 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.787370 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-vdg9q" podStartSLOduration=2.432384299 podStartE2EDuration="4.787331911s" totalImagesPullingTime="2.354947612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:37.785688337 +0000 UTC m=+62.935815363" watchObservedRunningTime="2026-07-27 17:47:37.787331911 +0000 UTC m=+62.937458912" Jul 27 17:47:37.790504 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.790468 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:37.891523 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.891491 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:37.931565 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:37.931517 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:38.171867 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.170502 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c469fd87f-b757d"] Jul 27 17:47:38.173018 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.172989 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:38.173135 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.173113 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.188876 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.188850 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c469fd87f-b757d"] Jul 27 17:47:38.191403 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.191378 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv"] Jul 27 17:47:38.194134 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.193775 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:38.196432 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.196195 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 27 17:47:38.196432 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.196239 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mq8xg\"" Jul 27 17:47:38.204159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.204133 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv"] Jul 27 17:47:38.245403 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245369 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-h4kcv\" (UID: \"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:38.245561 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245436 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfpgj\" (UniqueName: \"kubernetes.io/projected/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-kube-api-access-hfpgj\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.245561 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245477 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rnbw\" (UniqueName: \"kubernetes.io/projected/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-kube-api-access-9rnbw\") pod \"monitoring-plugin-68b7fc9574-h4kcv\" (UID: \"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:38.245561 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245546 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-service-ca\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.245718 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245579 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-trusted-ca-bundle\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.245718 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245663 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-serving-cert\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.245718 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245689 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-oauth-config\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.245824 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245738 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-oauth-serving-cert\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.245857 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.245833 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-config\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.265159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.265129 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:38.346278 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.346245 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-config\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.346419 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.346313 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-h4kcv\" (UID: \"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:38.346419 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.346369 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfpgj\" (UniqueName: \"kubernetes.io/projected/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-kube-api-access-hfpgj\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.346419 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.346406 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rnbw\" (UniqueName: \"kubernetes.io/projected/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-kube-api-access-9rnbw\") pod \"monitoring-plugin-68b7fc9574-h4kcv\" (UID: \"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:38.346585 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.346459 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-service-ca\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.346585 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:38.346475 2585 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 27 17:47:38.346585 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.346492 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-trusted-ca-bundle\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.347195 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.347168 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-config\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.347741 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.347381 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-service-ca\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.347885 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:47:38.347770 2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-monitoring-plugin-cert podName:ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8 nodeName:}" failed. No retries permitted until 2026-07-27 17:47:38.847746938 +0000 UTC m=+63.997873918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-h4kcv" (UID: "ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8") : secret "monitoring-plugin-cert" not found Jul 27 17:47:38.347954 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.347887 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-serving-cert\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.347954 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.347916 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-oauth-config\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.348057 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.347966 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-oauth-serving-cert\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.349419 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.348309 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-trusted-ca-bundle\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.349419 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.348825 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-oauth-serving-cert\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.350616 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.350573 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-oauth-config\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.350779 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.350761 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-serving-cert\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.357232 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.357205 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rnbw\" (UniqueName: \"kubernetes.io/projected/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-kube-api-access-9rnbw\") pod \"monitoring-plugin-68b7fc9574-h4kcv\" (UID: \"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:38.357914 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.357881 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfpgj\" (UniqueName: \"kubernetes.io/projected/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-kube-api-access-hfpgj\") pod \"console-c469fd87f-b757d\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.366302 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.366280 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55744fd7cc-sn5ff"] Jul 27 17:47:38.372484 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:38.372458 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c286d71_546c_421e_bf23_61c51b2041ee.slice/crio-673e6ade28415ed28215ad593a2110d6241097baad6f68776fe2943fe4d0d451 WatchSource:0}: Error finding container 673e6ade28415ed28215ad593a2110d6241097baad6f68776fe2943fe4d0d451: Status 404 returned error can't find the container with id 673e6ade28415ed28215ad593a2110d6241097baad6f68776fe2943fe4d0d451 Jul 27 17:47:38.486013 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.485979 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:38.583687 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.583655 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:38.660075 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.660027 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c469fd87f-b757d"] Jul 27 17:47:38.662537 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:38.662504 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0508d0ce_56d4_4cc7_ab9d_cada12fd32f1.slice/crio-0b959cbb814c2f05ff48d29b5ee4a02eb6b9f6fee2e9ca422af07887ba1d1dba WatchSource:0}: Error finding container 0b959cbb814c2f05ff48d29b5ee4a02eb6b9f6fee2e9ca422af07887ba1d1dba: Status 404 returned error can't find the container with id 0b959cbb814c2f05ff48d29b5ee4a02eb6b9f6fee2e9ca422af07887ba1d1dba Jul 27 17:47:38.736059 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.736025 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" event={"ID":"c99ef2d2-2bdf-45a7-a406-cdd788d9addc","Type":"ContainerStarted","Data":"7c335a0c555d656cdfb3b73cfada35e7f623eb71c99e88e807d9938626dbf319"} Jul 27 17:47:38.736192 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.736124 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" event={"ID":"c99ef2d2-2bdf-45a7-a406-cdd788d9addc","Type":"ContainerStarted","Data":"709e2abfc4056f463fdfb7b373b357803c65cf8a3cac7c426976704e2e8b3c9a"} Jul 27 17:47:38.736192 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.736171 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" event={"ID":"c99ef2d2-2bdf-45a7-a406-cdd788d9addc","Type":"ContainerStarted","Data":"f13a795dac43d3b22a0fa6785c1ae9c3ff4c01e2ce67a14065ccf127a813dd0e"} Jul 27 17:47:38.738132 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.738105 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c469fd87f-b757d" event={"ID":"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1","Type":"ContainerStarted","Data":"0b959cbb814c2f05ff48d29b5ee4a02eb6b9f6fee2e9ca422af07887ba1d1dba"} Jul 27 17:47:38.739508 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.739486 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" event={"ID":"8c286d71-546c-421e-bf23-61c51b2041ee","Type":"ContainerStarted","Data":"673e6ade28415ed28215ad593a2110d6241097baad6f68776fe2943fe4d0d451"} Jul 27 17:47:38.859596 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.859557 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-h4kcv\" (UID: \"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:38.862704 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:38.862679 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-h4kcv\" (UID: \"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:39.106069 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.106028 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:39.358481 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.358391 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:39.453582 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.453542 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:39.633521 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.631456 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:39.638598 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.638571 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 17:47:39.643467 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.643444 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.647890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.646151 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-frhz9\"" Jul 27 17:47:39.647890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.646425 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 17:47:39.647890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.646788 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 17:47:39.647890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.646971 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5oichcigavhl3\"" Jul 27 17:47:39.647890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.647167 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 17:47:39.647890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.647405 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 17:47:39.647890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.647602 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 17:47:39.647890 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.647845 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 17:47:39.648248 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.648040 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 17:47:39.648248 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.648159 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 17:47:39.648248 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.648194 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 17:47:39.648248 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.648220 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 17:47:39.648457 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.648437 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 17:47:39.648541 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.648439 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 17:47:39.648878 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.648856 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 17:47:39.650185 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.650164 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 17:47:39.658826 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.658799 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 17:47:39.746975 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.746931 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c469fd87f-b757d" event={"ID":"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1","Type":"ContainerStarted","Data":"c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1"} Jul 27 17:47:39.768848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.768807 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.768848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.768855 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.768873 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.768902 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.768926 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.768994 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769048 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-config\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769066 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769364 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769120 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769364 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769147 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769364 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769207 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769364 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769255 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769364 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769290 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769364 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769312 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769607 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769384 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769607 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769407 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769607 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769432 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769607 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769458 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769607 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769479 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.769607 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.769505 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g84xd\" (UniqueName: \"kubernetes.io/projected/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-kube-api-access-g84xd\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.771125 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.771070 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c469fd87f-b757d" podStartSLOduration=1.7710501029999999 podStartE2EDuration="1.771050103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:39.770071883 +0000 UTC m=+64.920198898" watchObservedRunningTime="2026-07-27 17:47:39.771050103 +0000 UTC m=+64.921177106" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870503 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870585 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870616 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870647 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870665 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870703 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870717 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870738 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870759 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870773 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870795 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g84xd\" (UniqueName: \"kubernetes.io/projected/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-kube-api-access-g84xd\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.870843 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870836 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870867 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870899 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870942 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870967 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.870996 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.871031 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-config\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.871055 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.871126 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.871452 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.871323 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.879874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.871998 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.879874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.872396 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.879874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.873767 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.879874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.874776 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.879874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.877592 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.879874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.877652 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-config\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.879874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.878294 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.879874 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.878505 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.880909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.880866 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.881684 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.881624 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.881797 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.881756 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.882637 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.882614 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.884391 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.884280 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.884919 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.884878 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.884919 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.884900 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.885133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.885111 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.886119 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.886094 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.886973 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.886925 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.897988 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.897932 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g84xd\" (UniqueName: \"kubernetes.io/projected/e2baeb8e-0f71-48a1-89ac-c3b43d117c90-kube-api-access-g84xd\") pod \"prometheus-k8s-0\" (UID: \"e2baeb8e-0f71-48a1-89ac-c3b43d117c90\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:39.959417 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:39.959145 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:40.264585 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.264522 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv"] Jul 27 17:47:40.300461 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.300436 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 17:47:40.315050 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:40.314919 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2baeb8e_0f71_48a1_89ac_c3b43d117c90.slice/crio-2d0e5da9f553433fe201ee362b1259fee1eff947d7f9aeabd92b13330c37810c WatchSource:0}: Error finding container 2d0e5da9f553433fe201ee362b1259fee1eff947d7f9aeabd92b13330c37810c: Status 404 returned error can't find the container with id 2d0e5da9f553433fe201ee362b1259fee1eff947d7f9aeabd92b13330c37810c Jul 27 17:47:40.753578 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.753544 2585 generic.go:356] "Generic (PLEG): container finished" podID="e2baeb8e-0f71-48a1-89ac-c3b43d117c90" containerID="b14bb37a603946061b80584f7cfa5020aee92e9d5cd2e63411077fd42bcfb71d" exitCode=0 Jul 27 17:47:40.753991 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.753631 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2baeb8e-0f71-48a1-89ac-c3b43d117c90","Type":"ContainerDied","Data":"b14bb37a603946061b80584f7cfa5020aee92e9d5cd2e63411077fd42bcfb71d"} Jul 27 17:47:40.753991 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.753720 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2baeb8e-0f71-48a1-89ac-c3b43d117c90","Type":"ContainerStarted","Data":"2d0e5da9f553433fe201ee362b1259fee1eff947d7f9aeabd92b13330c37810c"} Jul 27 17:47:40.756010 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.755986 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" event={"ID":"8c286d71-546c-421e-bf23-61c51b2041ee","Type":"ContainerStarted","Data":"9c5a3539ab63f151fb7eb232b824d425c2d20552613e4033d001974648ab9b01"} Jul 27 17:47:40.759714 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.759684 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4b79c11-917e-4c13-bf1c-ac3d8236ee19","Type":"ContainerStarted","Data":"8d0fecd6b321c0c593875fc9a56c51767982e16c02f14f4e0e1abd7ee2ffc3a7"} Jul 27 17:47:40.759823 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.759749 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4b79c11-917e-4c13-bf1c-ac3d8236ee19","Type":"ContainerStarted","Data":"b25bca159099e465ad9edd59399fcb51149711c63c173bac4144e22c625489c3"} Jul 27 17:47:40.759823 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.759790 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4b79c11-917e-4c13-bf1c-ac3d8236ee19","Type":"ContainerStarted","Data":"cce1fa6574d52ee9af53ba616b97423a9db24dd6acfa438eeae219fc908806dd"} Jul 27 17:47:40.759909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.759827 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4b79c11-917e-4c13-bf1c-ac3d8236ee19","Type":"ContainerStarted","Data":"b1078d0992aaa081608824f5d75b3f9458c88e25c8ecfffce8c1ad3cb5324222"} Jul 27 17:47:40.759909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.759867 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4b79c11-917e-4c13-bf1c-ac3d8236ee19","Type":"ContainerStarted","Data":"ba925404e0a6f1be91f0292c3992dcfccdfc824b634338e75453a0f7bb47e650"} Jul 27 17:47:40.759909 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.759900 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c4b79c11-917e-4c13-bf1c-ac3d8236ee19","Type":"ContainerStarted","Data":"356fcb9c9e17b5205dab5a04485d9e824cd2bcd672fe8ef1cdb58d12ea0790df"} Jul 27 17:47:40.763039 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.763015 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" event={"ID":"c99ef2d2-2bdf-45a7-a406-cdd788d9addc","Type":"ContainerStarted","Data":"15c5fa9ee41da26bf191f7e0c9833d91e701c5d1e79d05a877668933f5873bc2"} Jul 27 17:47:40.763128 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.763082 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" event={"ID":"c99ef2d2-2bdf-45a7-a406-cdd788d9addc","Type":"ContainerStarted","Data":"b052709b849bca537433351e4c15b7df8d4c283e5a6bba99b2a2f6f8bcb7f41c"} Jul 27 17:47:40.763184 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.763173 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:40.763225 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.763201 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" event={"ID":"c99ef2d2-2bdf-45a7-a406-cdd788d9addc","Type":"ContainerStarted","Data":"bb37f6997f8369d02f7be0444bb381a78cc63ca0667b2a586715bb374a5e31a0"} Jul 27 17:47:40.764276 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.764248 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" event={"ID":"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8","Type":"ContainerStarted","Data":"62ff0901e6481f557c516e7ba31b88617bad6752edfda6ce0c0a295d8ff9478d"} Jul 27 17:47:40.802888 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.802833 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" podStartSLOduration=2.108417702 podStartE2EDuration="3.802816209s" totalImagesPullingTime="1.694398507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:40.802173547 +0000 UTC m=+65.952300550" watchObservedRunningTime="2026-07-27 17:47:40.802816209 +0000 UTC m=+65.952943211" Jul 27 17:47:40.826865 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.826812 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" podStartSLOduration=1.8545728339999998 podStartE2EDuration="5.826794808s" totalImagesPullingTime="3.972221974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:40.825002564 +0000 UTC m=+65.975129604" watchObservedRunningTime="2026-07-27 17:47:40.826794808 +0000 UTC m=+65.976921810" Jul 27 17:47:40.854402 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.854327 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.325641734 podStartE2EDuration="6.854310208s" totalImagesPullingTime="3.516300944s" totalInitContainerRuntime="12.36753ms" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:40.852194476 +0000 UTC m=+66.002321479" watchObservedRunningTime="2026-07-27 17:47:40.854310208 +0000 UTC m=+66.004437209" Jul 27 17:47:40.988965 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.988874 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:40.992263 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:40.992234 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 17:47:41.001857 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.001830 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7fdc6818-a0a9-4b91-a91f-a077f73273f0-metrics-certs\") pod \"network-metrics-daemon-xmb7v\" (UID: \"7fdc6818-a0a9-4b91-a91f-a077f73273f0\") " pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:41.089927 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.089886 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:41.092568 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.092545 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 17:47:41.102792 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.102769 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c647f46c-9b00-443b-83b9-42d76ed6b23d-original-pull-secret\") pod \"global-pull-secret-syncer-cn72p\" (UID: \"c647f46c-9b00-443b-83b9-42d76ed6b23d\") " pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:41.109677 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.109661 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cn72p" Jul 27 17:47:41.120435 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.120411 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l9688\"" Jul 27 17:47:41.128720 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.128698 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmb7v" Jul 27 17:47:41.190858 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.190692 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:41.193734 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.193626 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 17:47:41.204206 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.204177 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 17:47:41.215667 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.215595 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52zk7\" (UniqueName: \"kubernetes.io/projected/190af8d8-eec3-4faa-89dc-0b26abc43221-kube-api-access-52zk7\") pod \"network-check-target-hdpfk\" (UID: \"190af8d8-eec3-4faa-89dc-0b26abc43221\") " pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:41.311445 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.311372 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cn72p"] Jul 27 17:47:41.346039 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.346011 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmb7v"] Jul 27 17:47:41.428707 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.428678 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b7fvg\"" Jul 27 17:47:41.437047 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.436806 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:41.822790 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:41.822756 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc647f46c_9b00_443b_83b9_42d76ed6b23d.slice/crio-82429fa3e68fba134d163badbfff6fc3936bd6ccc31aead87a2ad76264e62460 WatchSource:0}: Error finding container 82429fa3e68fba134d163badbfff6fc3936bd6ccc31aead87a2ad76264e62460: Status 404 returned error can't find the container with id 82429fa3e68fba134d163badbfff6fc3936bd6ccc31aead87a2ad76264e62460 Jul 27 17:47:41.823624 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:41.823592 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fdc6818_a0a9_4b91_a91f_a077f73273f0.slice/crio-9b5377a0840eb3f02647958629f16ffe9bef699000bbb44577b316aed2c4219f WatchSource:0}: Error finding container 9b5377a0840eb3f02647958629f16ffe9bef699000bbb44577b316aed2c4219f: Status 404 returned error can't find the container with id 9b5377a0840eb3f02647958629f16ffe9bef699000bbb44577b316aed2c4219f Jul 27 17:47:41.970867 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:41.970841 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hdpfk"] Jul 27 17:47:41.973826 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:47:41.973794 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190af8d8_eec3_4faa_89dc_0b26abc43221.slice/crio-39edb9fe321787e0256999e8c8374e781569704360123ae60b57d89632eaca5d WatchSource:0}: Error finding container 39edb9fe321787e0256999e8c8374e781569704360123ae60b57d89632eaca5d: Status 404 returned error can't find the container with id 39edb9fe321787e0256999e8c8374e781569704360123ae60b57d89632eaca5d Jul 27 17:47:42.061129 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.061096 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:42.121298 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.121210 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:42.780664 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.780588 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hdpfk" event={"ID":"190af8d8-eec3-4faa-89dc-0b26abc43221","Type":"ContainerStarted","Data":"39edb9fe321787e0256999e8c8374e781569704360123ae60b57d89632eaca5d"} Jul 27 17:47:42.783802 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.783320 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" event={"ID":"ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8","Type":"ContainerStarted","Data":"94d809287ceeb17d17b33a10716ff052e5823c952c4d3a4ea61bc9507c4144d9"} Jul 27 17:47:42.783802 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.783701 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:42.785822 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.785751 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cn72p" event={"ID":"c647f46c-9b00-443b-83b9-42d76ed6b23d","Type":"ContainerStarted","Data":"82429fa3e68fba134d163badbfff6fc3936bd6ccc31aead87a2ad76264e62460"} Jul 27 17:47:42.788488 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.788410 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmb7v" event={"ID":"7fdc6818-a0a9-4b91-a91f-a077f73273f0","Type":"ContainerStarted","Data":"9b5377a0840eb3f02647958629f16ffe9bef699000bbb44577b316aed2c4219f"} Jul 27 17:47:42.790391 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.790322 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" Jul 27 17:47:42.821392 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:42.820524 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-h4kcv" podStartSLOduration=2.925521176 podStartE2EDuration="4.820502278s" totalImagesPullingTime="1.894981102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:42.802560783 +0000 UTC m=+67.952687786" watchObservedRunningTime="2026-07-27 17:47:42.820502278 +0000 UTC m=+67.970629273" Jul 27 17:47:43.799136 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:43.799013 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmb7v" event={"ID":"7fdc6818-a0a9-4b91-a91f-a077f73273f0","Type":"ContainerStarted","Data":"4cff79d7782de1504edf4f338e078820fc7966d0dc412e870510f26e164cf276"} Jul 27 17:47:43.799136 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:43.799092 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmb7v" event={"ID":"7fdc6818-a0a9-4b91-a91f-a077f73273f0","Type":"ContainerStarted","Data":"634ec96589eeb31aba58258ffcb4bb24c8a21ca1668e6914793256200e824775"} Jul 27 17:47:43.825181 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:43.825120 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xmb7v" podStartSLOduration=67.555799235 podStartE2EDuration="1m8.825098386s" totalImagesPullingTime="1.269299151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:43.822596317 +0000 UTC m=+68.972723320" watchObservedRunningTime="2026-07-27 17:47:43.825098386 +0000 UTC m=+68.975225392" Jul 27 17:47:43.918647 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:43.918611 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:44.004025 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:44.003930 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:44.066087 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:44.066057 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:46.776727 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:46.776696 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69dd89c97d-r6ct8" Jul 27 17:47:47.062215 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:47.062175 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:47.139049 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:47.139001 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:47.825776 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:47.825739 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hdpfk" event={"ID":"190af8d8-eec3-4faa-89dc-0b26abc43221","Type":"ContainerStarted","Data":"f2d594729bd9dfbf0ba88acc1a42fe54c28a5fd47042a99897dc4f16f9eb97c6"} Jul 27 17:47:47.828954 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:47.828921 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2baeb8e-0f71-48a1-89ac-c3b43d117c90","Type":"ContainerStarted","Data":"669a58f37ea152146bf49be3de7c81694f6b729a2b06a721cfe4a0ece71e8853"} Jul 27 17:47:48.486107 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.486071 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:48.486232 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.486177 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:48.491435 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.491412 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:48.837867 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.837828 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cn72p" event={"ID":"c647f46c-9b00-443b-83b9-42d76ed6b23d","Type":"ContainerStarted","Data":"0166ee622625e98b0c35608cdf026a85bf325c1c695b352607efb33c82d5d3c1"} Jul 27 17:47:48.841219 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.841164 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2baeb8e-0f71-48a1-89ac-c3b43d117c90","Type":"ContainerStarted","Data":"ed6db880278ca3be6fb804d7f79194ffffbf7efe1fd41b773df3a03f03c39b06"} Jul 27 17:47:48.841388 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.841258 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2baeb8e-0f71-48a1-89ac-c3b43d117c90","Type":"ContainerStarted","Data":"015e531d8a61857c889a92006cde997fca7ebaef27d6348ad0f4de8ca787ae4f"} Jul 27 17:47:48.841388 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.841304 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2baeb8e-0f71-48a1-89ac-c3b43d117c90","Type":"ContainerStarted","Data":"718d26ef6424fb6e8c4fe79ebe45e02eddc1a499ce301ec04053ea4984632a91"} Jul 27 17:47:48.841388 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.841360 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2baeb8e-0f71-48a1-89ac-c3b43d117c90","Type":"ContainerStarted","Data":"980791e9005a9f86fd638364db060e36d9e35b9b73cbaf166e4be6e6975c35ba"} Jul 27 17:47:48.841531 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.841397 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2baeb8e-0f71-48a1-89ac-c3b43d117c90","Type":"ContainerStarted","Data":"7184fef36e3c2f51754abd395e47ed3185c6bf787f23a3a51746124bd4463fbd"} Jul 27 17:47:48.841589 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.841555 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:47:48.844998 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.844975 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:47:48.891597 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.891543 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cn72p" podStartSLOduration=68.013225501 podStartE2EDuration="1m13.891522168s" totalImagesPullingTime="5.878296667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:48.889705594 +0000 UTC m=+74.039832589" watchObservedRunningTime="2026-07-27 17:47:48.891522168 +0000 UTC m=+74.041649171" Jul 27 17:47:48.911834 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.911777 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hdpfk" podStartSLOduration=68.193619432 podStartE2EDuration="1m13.911760865s" totalImagesPullingTime="5.718141433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:48.910456787 +0000 UTC m=+74.060583790" watchObservedRunningTime="2026-07-27 17:47:48.911760865 +0000 UTC m=+74.061887868" Jul 27 17:47:48.953998 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.953956 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c949fc57b-nvvzc"] Jul 27 17:47:48.957466 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:48.957376 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.992627208 podStartE2EDuration="9.957325353s" totalImagesPullingTime="6.939973886s" totalInitContainerRuntime="24.724259ms" isStatefulPod=false podCreationTimestamp="2026-07-27 17:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:47:48.955993551 +0000 UTC m=+74.106120555" watchObservedRunningTime="2026-07-27 17:47:48.957325353 +0000 UTC m=+74.107452356" Jul 27 17:47:49.062980 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:49.062918 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:49.169407 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:49.169298 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:49.465376 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:49.465226 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:47:49.959326 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:49.959287 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:47:57.756989 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:57.756865 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cc9b568d5-r7lxz" podUID="9e93e8f0-9684-404e-8d9b-49d399b07466" containerName="console" containerID="cri-o://3b15b60365d9059fb7d6b92cb618e5c00f04f412ef7c4e5eb0e2d61d5730f7fc" gracePeriod=15 Jul 27 17:47:57.881320 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:57.881289 2585 generic.go:356] "Generic (PLEG): container finished" podID="9e93e8f0-9684-404e-8d9b-49d399b07466" containerID="3b15b60365d9059fb7d6b92cb618e5c00f04f412ef7c4e5eb0e2d61d5730f7fc" exitCode=0 Jul 27 17:47:57.881473 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:57.881327 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9b568d5-r7lxz" event={"ID":"9e93e8f0-9684-404e-8d9b-49d399b07466","Type":"ContainerDied","Data":"3b15b60365d9059fb7d6b92cb618e5c00f04f412ef7c4e5eb0e2d61d5730f7fc"} Jul 27 17:47:57.932642 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:57.932612 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:57.932784 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:57.932680 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:47:58.009734 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.009680 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:58.170839 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.170803 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-oauth-config\") pod \"9e93e8f0-9684-404e-8d9b-49d399b07466\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " Jul 27 17:47:58.171043 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.170865 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5767d\" (UniqueName: \"kubernetes.io/projected/9e93e8f0-9684-404e-8d9b-49d399b07466-kube-api-access-5767d\") pod \"9e93e8f0-9684-404e-8d9b-49d399b07466\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " Jul 27 17:47:58.171043 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.170896 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-oauth-serving-cert\") pod \"9e93e8f0-9684-404e-8d9b-49d399b07466\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " Jul 27 17:47:58.171043 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.170915 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-console-config\") pod \"9e93e8f0-9684-404e-8d9b-49d399b07466\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " Jul 27 17:47:58.171208 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.171076 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-service-ca\") pod \"9e93e8f0-9684-404e-8d9b-49d399b07466\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " Jul 27 17:47:58.171208 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.171143 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-serving-cert\") pod \"9e93e8f0-9684-404e-8d9b-49d399b07466\" (UID: \"9e93e8f0-9684-404e-8d9b-49d399b07466\") " Jul 27 17:47:58.171395 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.171370 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e93e8f0-9684-404e-8d9b-49d399b07466" (UID: "9e93e8f0-9684-404e-8d9b-49d399b07466"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:47:58.171395 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.171378 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-console-config" (OuterVolumeSpecName: "console-config") pod "9e93e8f0-9684-404e-8d9b-49d399b07466" (UID: "9e93e8f0-9684-404e-8d9b-49d399b07466"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:47:58.171513 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.171424 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e93e8f0-9684-404e-8d9b-49d399b07466" (UID: "9e93e8f0-9684-404e-8d9b-49d399b07466"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:47:58.171567 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.171523 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-oauth-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:47:58.171567 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.171536 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-console-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:47:58.171567 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.171545 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e93e8f0-9684-404e-8d9b-49d399b07466-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:47:58.173546 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.173516 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e93e8f0-9684-404e-8d9b-49d399b07466-kube-api-access-5767d" (OuterVolumeSpecName: "kube-api-access-5767d") pod "9e93e8f0-9684-404e-8d9b-49d399b07466" (UID: "9e93e8f0-9684-404e-8d9b-49d399b07466"). InnerVolumeSpecName "kube-api-access-5767d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:47:58.173546 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.173531 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e93e8f0-9684-404e-8d9b-49d399b07466" (UID: "9e93e8f0-9684-404e-8d9b-49d399b07466"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:47:58.173686 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.173617 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e93e8f0-9684-404e-8d9b-49d399b07466" (UID: "9e93e8f0-9684-404e-8d9b-49d399b07466"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:47:58.273006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.272907 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5767d\" (UniqueName: \"kubernetes.io/projected/9e93e8f0-9684-404e-8d9b-49d399b07466-kube-api-access-5767d\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:47:58.273006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.272945 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:47:58.273006 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.272957 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e93e8f0-9684-404e-8d9b-49d399b07466-console-oauth-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:47:58.887387 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.887330 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cc9b568d5-r7lxz" event={"ID":"9e93e8f0-9684-404e-8d9b-49d399b07466","Type":"ContainerDied","Data":"9619b6cc2c31b51f0ea5cc74ba493a83b44b02b9ab25be176f0eaefc829416a7"} Jul 27 17:47:58.887387 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.887381 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cc9b568d5-r7lxz" Jul 27 17:47:58.887876 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.887417 2585 scope.go:117] "RemoveContainer" containerID="3b15b60365d9059fb7d6b92cb618e5c00f04f412ef7c4e5eb0e2d61d5730f7fc" Jul 27 17:47:58.912171 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.912140 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cc9b568d5-r7lxz"] Jul 27 17:47:58.914124 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:58.914102 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cc9b568d5-r7lxz"] Jul 27 17:47:59.401755 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:47:59.401719 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e93e8f0-9684-404e-8d9b-49d399b07466" path="/var/lib/kubelet/pods/9e93e8f0-9684-404e-8d9b-49d399b07466/volumes" Jul 27 17:48:02.172721 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:02.172686 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:48:02.227076 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:02.227042 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:48:13.975459 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:13.975390 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c949fc57b-nvvzc" podUID="646cf84a-bd2a-4f06-821b-67ebc92b31df" containerName="console" containerID="cri-o://9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53" gracePeriod=15 Jul 27 17:48:14.734386 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.734335 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:48:14.815863 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.815817 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-trusted-ca-bundle\") pod \"646cf84a-bd2a-4f06-821b-67ebc92b31df\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " Jul 27 17:48:14.815863 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.815862 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-service-ca\") pod \"646cf84a-bd2a-4f06-821b-67ebc92b31df\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " Jul 27 17:48:14.816116 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.815913 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-oauth-config\") pod \"646cf84a-bd2a-4f06-821b-67ebc92b31df\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " Jul 27 17:48:14.816116 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.815941 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-serving-cert\") pod \"646cf84a-bd2a-4f06-821b-67ebc92b31df\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " Jul 27 17:48:14.816116 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.815966 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8krrs\" (UniqueName: \"kubernetes.io/projected/646cf84a-bd2a-4f06-821b-67ebc92b31df-kube-api-access-8krrs\") pod \"646cf84a-bd2a-4f06-821b-67ebc92b31df\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " Jul 27 17:48:14.816116 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.815985 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-oauth-serving-cert\") pod \"646cf84a-bd2a-4f06-821b-67ebc92b31df\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " Jul 27 17:48:14.816116 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.816064 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-config\") pod \"646cf84a-bd2a-4f06-821b-67ebc92b31df\" (UID: \"646cf84a-bd2a-4f06-821b-67ebc92b31df\") " Jul 27 17:48:14.816394 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.816290 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "646cf84a-bd2a-4f06-821b-67ebc92b31df" (UID: "646cf84a-bd2a-4f06-821b-67ebc92b31df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:48:14.816495 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.816470 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-service-ca" (OuterVolumeSpecName: "service-ca") pod "646cf84a-bd2a-4f06-821b-67ebc92b31df" (UID: "646cf84a-bd2a-4f06-821b-67ebc92b31df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:48:14.816609 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.816579 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-config" (OuterVolumeSpecName: "console-config") pod "646cf84a-bd2a-4f06-821b-67ebc92b31df" (UID: "646cf84a-bd2a-4f06-821b-67ebc92b31df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:48:14.816698 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.816674 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "646cf84a-bd2a-4f06-821b-67ebc92b31df" (UID: "646cf84a-bd2a-4f06-821b-67ebc92b31df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:48:14.818563 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.818526 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "646cf84a-bd2a-4f06-821b-67ebc92b31df" (UID: "646cf84a-bd2a-4f06-821b-67ebc92b31df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:48:14.818674 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.818566 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/646cf84a-bd2a-4f06-821b-67ebc92b31df-kube-api-access-8krrs" (OuterVolumeSpecName: "kube-api-access-8krrs") pod "646cf84a-bd2a-4f06-821b-67ebc92b31df" (UID: "646cf84a-bd2a-4f06-821b-67ebc92b31df"). InnerVolumeSpecName "kube-api-access-8krrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:48:14.818674 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.818582 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "646cf84a-bd2a-4f06-821b-67ebc92b31df" (UID: "646cf84a-bd2a-4f06-821b-67ebc92b31df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:48:14.917133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.917042 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:48:14.917133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.917072 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-oauth-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:48:14.917133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.917081 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:48:14.917133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.917090 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8krrs\" (UniqueName: \"kubernetes.io/projected/646cf84a-bd2a-4f06-821b-67ebc92b31df-kube-api-access-8krrs\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:48:14.917133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.917100 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-oauth-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:48:14.917133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.917110 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-console-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:48:14.917133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.917118 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/646cf84a-bd2a-4f06-821b-67ebc92b31df-trusted-ca-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:48:14.968730 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.968696 2585 generic.go:356] "Generic (PLEG): container finished" podID="646cf84a-bd2a-4f06-821b-67ebc92b31df" containerID="9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53" exitCode=0 Jul 27 17:48:14.968894 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.968747 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c949fc57b-nvvzc" Jul 27 17:48:14.968894 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.968759 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c949fc57b-nvvzc" event={"ID":"646cf84a-bd2a-4f06-821b-67ebc92b31df","Type":"ContainerDied","Data":"9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53"} Jul 27 17:48:14.968894 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.968816 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c949fc57b-nvvzc" event={"ID":"646cf84a-bd2a-4f06-821b-67ebc92b31df","Type":"ContainerDied","Data":"d85ad7fe65179e30eba507ed5f656453b5e5dee7b961bfd5f8e1ead7a4af7403"} Jul 27 17:48:14.968894 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.968837 2585 scope.go:117] "RemoveContainer" containerID="9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53" Jul 27 17:48:14.977925 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.977751 2585 scope.go:117] "RemoveContainer" containerID="9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53" Jul 27 17:48:14.978192 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:48:14.978069 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53\": container with ID starting with 9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53 not found: ID does not exist" containerID="9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53" Jul 27 17:48:14.978192 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.978111 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53"} err="failed to get container status \"9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53\": rpc error: code = NotFound desc = could not find container \"9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53\": container with ID starting with 9ddfe839dd1e4955add4ed5725e0255771d60f3a9117a9ec0a22a95ee6165c53 not found: ID does not exist" Jul 27 17:48:14.989420 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.989395 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c949fc57b-nvvzc"] Jul 27 17:48:14.993217 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:14.993192 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c949fc57b-nvvzc"] Jul 27 17:48:15.401744 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:15.401707 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="646cf84a-bd2a-4f06-821b-67ebc92b31df" path="/var/lib/kubelet/pods/646cf84a-bd2a-4f06-821b-67ebc92b31df/volumes" Jul 27 17:48:17.937623 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:17.937589 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:48:17.942627 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:17.942603 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55744fd7cc-sn5ff" Jul 27 17:48:19.849720 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:19.849682 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hdpfk" Jul 27 17:48:34.891059 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:34.891020 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:48:39.959919 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:39.959877 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:48:39.980273 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:39.980246 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:48:40.083243 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:40.083218 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 17:48:52.626112 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:52.626074 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:48:52.826123 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:52.826087 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:48:54.896908 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:54.896877 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:48:57.003583 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:48:57.003545 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:02.265769 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.265732 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6857d4455-bhfz5"] Jul 27 17:49:02.266240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.266112 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e93e8f0-9684-404e-8d9b-49d399b07466" containerName="console" Jul 27 17:49:02.266240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.266125 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e93e8f0-9684-404e-8d9b-49d399b07466" containerName="console" Jul 27 17:49:02.266240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.266137 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="646cf84a-bd2a-4f06-821b-67ebc92b31df" containerName="console" Jul 27 17:49:02.266240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.266142 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="646cf84a-bd2a-4f06-821b-67ebc92b31df" containerName="console" Jul 27 17:49:02.266240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.266206 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="646cf84a-bd2a-4f06-821b-67ebc92b31df" containerName="console" Jul 27 17:49:02.266240 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.266219 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e93e8f0-9684-404e-8d9b-49d399b07466" containerName="console" Jul 27 17:49:02.268302 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.268283 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.279553 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.279527 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6857d4455-bhfz5"] Jul 27 17:49:02.324998 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.324953 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-serving-cert\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.324998 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.324991 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-oauth-config\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.325211 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.325014 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-console-config\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.325211 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.325031 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-oauth-serving-cert\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.325211 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.325118 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6vlr\" (UniqueName: \"kubernetes.io/projected/37950396-bb52-4219-9408-e396bb14d013-kube-api-access-p6vlr\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.325312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.325217 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-trusted-ca-bundle\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.325312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.325254 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-service-ca\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.348379 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.348321 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:02.418393 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.418332 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:02.426362 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.426322 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-serving-cert\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.426454 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.426373 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-oauth-config\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.426454 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.426404 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-console-config\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.426550 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.426524 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-oauth-serving-cert\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.426672 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.426653 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6vlr\" (UniqueName: \"kubernetes.io/projected/37950396-bb52-4219-9408-e396bb14d013-kube-api-access-p6vlr\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.426840 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.426808 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-trusted-ca-bundle\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.426916 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.426850 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-service-ca\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.427187 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.427164 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-console-config\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.427576 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.427542 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-service-ca\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.427817 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.427792 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-oauth-serving-cert\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.427858 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.427819 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-trusted-ca-bundle\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.429107 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.429090 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-serving-cert\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.429224 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.429204 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-oauth-config\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.436825 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.436797 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6vlr\" (UniqueName: \"kubernetes.io/projected/37950396-bb52-4219-9408-e396bb14d013-kube-api-access-p6vlr\") pod \"console-6857d4455-bhfz5\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.479583 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.479546 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:02.578151 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.578117 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:02.713697 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:02.713674 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6857d4455-bhfz5"] Jul 27 17:49:02.716090 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:49:02.716060 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37950396_bb52_4219_9408_e396bb14d013.slice/crio-43aa81b8a9788e0cb36fab46345279e52711779165b1f20789077b8a896c1b16 WatchSource:0}: Error finding container 43aa81b8a9788e0cb36fab46345279e52711779165b1f20789077b8a896c1b16: Status 404 returned error can't find the container with id 43aa81b8a9788e0cb36fab46345279e52711779165b1f20789077b8a896c1b16 Jul 27 17:49:03.163476 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:03.163442 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6857d4455-bhfz5" event={"ID":"37950396-bb52-4219-9408-e396bb14d013","Type":"ContainerStarted","Data":"bcddb5fc43efd091780be19b1573673053c927ad4ddac77fe8659018a446d530"} Jul 27 17:49:03.163654 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:03.163491 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6857d4455-bhfz5" event={"ID":"37950396-bb52-4219-9408-e396bb14d013","Type":"ContainerStarted","Data":"43aa81b8a9788e0cb36fab46345279e52711779165b1f20789077b8a896c1b16"} Jul 27 17:49:03.180778 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:03.180681 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6857d4455-bhfz5" podStartSLOduration=1.180660988 podStartE2EDuration="1.180660988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:49:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:49:03.180586998 +0000 UTC m=+148.330714003" watchObservedRunningTime="2026-07-27 17:49:03.180660988 +0000 UTC m=+148.330788005" Jul 27 17:49:04.481219 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:04.481188 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:04.538549 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:04.538506 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:07.973287 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:07.973256 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:08.076749 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.076714 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:08.101127 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.101089 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6857d4455-bhfz5"] Jul 27 17:49:08.129741 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.129712 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d5b76c4d8-bbghh"] Jul 27 17:49:08.132192 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.132175 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.142873 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.142851 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5b76c4d8-bbghh"] Jul 27 17:49:08.177657 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.177626 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjfn9\" (UniqueName: \"kubernetes.io/projected/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-kube-api-access-zjfn9\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.177836 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.177688 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-oauth-serving-cert\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.177836 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.177767 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-service-ca\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.177836 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.177814 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-serving-cert\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.177836 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.177835 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-oauth-config\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.177999 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.177866 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-trusted-ca-bundle\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.177999 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.177896 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-config\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.279128 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279027 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-config\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.279128 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279088 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjfn9\" (UniqueName: \"kubernetes.io/projected/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-kube-api-access-zjfn9\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.279412 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279162 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-oauth-serving-cert\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.279412 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279200 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-service-ca\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.279412 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279234 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-serving-cert\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.279412 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279260 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-oauth-config\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.279607 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279419 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-trusted-ca-bundle\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.279952 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279921 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-config\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.280086 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.279927 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-oauth-serving-cert\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.280086 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.280029 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-service-ca\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.280529 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.280504 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-trusted-ca-bundle\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.281899 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.281877 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-serving-cert\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.281993 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.281904 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-console-oauth-config\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.288465 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.288440 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjfn9\" (UniqueName: \"kubernetes.io/projected/ca16e8dd-af66-4c9a-9dda-7af6079d7cb5-kube-api-access-zjfn9\") pod \"console-6d5b76c4d8-bbghh\" (UID: \"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5\") " pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.441971 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.441919 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:08.575523 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:08.575492 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5b76c4d8-bbghh"] Jul 27 17:49:08.578618 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:49:08.578580 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca16e8dd_af66_4c9a_9dda_7af6079d7cb5.slice/crio-faa1eb18585fb824375d348abfaa866b7c41640a5ad38f213bdf3e5097d1ec3a WatchSource:0}: Error finding container faa1eb18585fb824375d348abfaa866b7c41640a5ad38f213bdf3e5097d1ec3a: Status 404 returned error can't find the container with id faa1eb18585fb824375d348abfaa866b7c41640a5ad38f213bdf3e5097d1ec3a Jul 27 17:49:09.198527 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:09.198484 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5b76c4d8-bbghh" event={"ID":"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5","Type":"ContainerStarted","Data":"412fb6e943ce966c283a964af732271339d6db5771062f688d29f2d559f4ec2b"} Jul 27 17:49:09.198936 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:09.198552 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5b76c4d8-bbghh" event={"ID":"ca16e8dd-af66-4c9a-9dda-7af6079d7cb5","Type":"ContainerStarted","Data":"faa1eb18585fb824375d348abfaa866b7c41640a5ad38f213bdf3e5097d1ec3a"} Jul 27 17:49:09.215516 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:09.215457 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d5b76c4d8-bbghh" podStartSLOduration=1.215439565 podStartE2EDuration="1.215439565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:49:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:49:09.215165149 +0000 UTC m=+154.365292151" watchObservedRunningTime="2026-07-27 17:49:09.215439565 +0000 UTC m=+154.365566566" Jul 27 17:49:12.579226 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:12.579159 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:18.442554 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:18.442514 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:18.443019 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:18.442595 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:18.447413 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:18.447387 2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:19.244139 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:19.244111 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d5b76c4d8-bbghh" Jul 27 17:49:19.292282 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:19.292242 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c469fd87f-b757d"] Jul 27 17:49:19.403918 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:19.403887 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:19.714646 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:19.714611 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:19.819790 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:19.819759 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:19.876482 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:19.876452 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:25.616886 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:25.616795 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:25.707968 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:25.707938 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:32.059638 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:32.059597 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:32.159650 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:32.159612 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:49:33.120642 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.120582 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6857d4455-bhfz5" podUID="37950396-bb52-4219-9408-e396bb14d013" containerName="console" containerID="cri-o://bcddb5fc43efd091780be19b1573673053c927ad4ddac77fe8659018a446d530" gracePeriod=15 Jul 27 17:49:33.302089 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.302058 2585 generic.go:356] "Generic (PLEG): container finished" podID="37950396-bb52-4219-9408-e396bb14d013" containerID="bcddb5fc43efd091780be19b1573673053c927ad4ddac77fe8659018a446d530" exitCode=0 Jul 27 17:49:33.302253 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.302134 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6857d4455-bhfz5" event={"ID":"37950396-bb52-4219-9408-e396bb14d013","Type":"ContainerDied","Data":"bcddb5fc43efd091780be19b1573673053c927ad4ddac77fe8659018a446d530"} Jul 27 17:49:33.359862 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.359831 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:33.417836 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.417749 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-trusted-ca-bundle\") pod \"37950396-bb52-4219-9408-e396bb14d013\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " Jul 27 17:49:33.417836 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.417806 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-service-ca\") pod \"37950396-bb52-4219-9408-e396bb14d013\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " Jul 27 17:49:33.418041 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.417838 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-oauth-serving-cert\") pod \"37950396-bb52-4219-9408-e396bb14d013\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " Jul 27 17:49:33.418041 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.417873 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6vlr\" (UniqueName: \"kubernetes.io/projected/37950396-bb52-4219-9408-e396bb14d013-kube-api-access-p6vlr\") pod \"37950396-bb52-4219-9408-e396bb14d013\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " Jul 27 17:49:33.418041 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.417903 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-oauth-config\") pod \"37950396-bb52-4219-9408-e396bb14d013\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " Jul 27 17:49:33.418041 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.417940 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-console-config\") pod \"37950396-bb52-4219-9408-e396bb14d013\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " Jul 27 17:49:33.418041 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.417962 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-serving-cert\") pod \"37950396-bb52-4219-9408-e396bb14d013\" (UID: \"37950396-bb52-4219-9408-e396bb14d013\") " Jul 27 17:49:33.418270 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.418200 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37950396-bb52-4219-9408-e396bb14d013" (UID: "37950396-bb52-4219-9408-e396bb14d013"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:49:33.418331 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.418315 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-service-ca" (OuterVolumeSpecName: "service-ca") pod "37950396-bb52-4219-9408-e396bb14d013" (UID: "37950396-bb52-4219-9408-e396bb14d013"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:49:33.418414 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.418356 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37950396-bb52-4219-9408-e396bb14d013" (UID: "37950396-bb52-4219-9408-e396bb14d013"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:49:33.418414 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.418381 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-console-config" (OuterVolumeSpecName: "console-config") pod "37950396-bb52-4219-9408-e396bb14d013" (UID: "37950396-bb52-4219-9408-e396bb14d013"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:49:33.420214 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.420187 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37950396-bb52-4219-9408-e396bb14d013" (UID: "37950396-bb52-4219-9408-e396bb14d013"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:49:33.420214 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.420209 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37950396-bb52-4219-9408-e396bb14d013" (UID: "37950396-bb52-4219-9408-e396bb14d013"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:49:33.420419 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.420202 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37950396-bb52-4219-9408-e396bb14d013-kube-api-access-p6vlr" (OuterVolumeSpecName: "kube-api-access-p6vlr") pod "37950396-bb52-4219-9408-e396bb14d013" (UID: "37950396-bb52-4219-9408-e396bb14d013"). InnerVolumeSpecName "kube-api-access-p6vlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:49:33.518726 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.518688 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-trusted-ca-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:33.518726 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.518719 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:33.518726 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.518729 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-oauth-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:33.518953 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.518739 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6vlr\" (UniqueName: \"kubernetes.io/projected/37950396-bb52-4219-9408-e396bb14d013-kube-api-access-p6vlr\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:33.518953 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.518749 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-oauth-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:33.518953 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.518757 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37950396-bb52-4219-9408-e396bb14d013-console-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:33.518953 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:33.518766 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37950396-bb52-4219-9408-e396bb14d013-console-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:34.308686 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:34.308656 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6857d4455-bhfz5" Jul 27 17:49:34.309133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:34.308657 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6857d4455-bhfz5" event={"ID":"37950396-bb52-4219-9408-e396bb14d013","Type":"ContainerDied","Data":"43aa81b8a9788e0cb36fab46345279e52711779165b1f20789077b8a896c1b16"} Jul 27 17:49:34.309133 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:34.308783 2585 scope.go:117] "RemoveContainer" containerID="bcddb5fc43efd091780be19b1573673053c927ad4ddac77fe8659018a446d530" Jul 27 17:49:34.347781 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:34.347743 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6857d4455-bhfz5"] Jul 27 17:49:34.354073 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:34.354042 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6857d4455-bhfz5"] Jul 27 17:49:35.402973 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:35.402933 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37950396-bb52-4219-9408-e396bb14d013" path="/var/lib/kubelet/pods/37950396-bb52-4219-9408-e396bb14d013/volumes" Jul 27 17:49:44.312213 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.312142 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c469fd87f-b757d" podUID="0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" containerName="console" containerID="cri-o://c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1" gracePeriod=15 Jul 27 17:49:44.554132 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.554107 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:49:44.623900 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.623813 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-service-ca\") pod \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " Jul 27 17:49:44.623900 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.623859 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfpgj\" (UniqueName: \"kubernetes.io/projected/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-kube-api-access-hfpgj\") pod \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " Jul 27 17:49:44.623900 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.623879 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-config\") pod \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " Jul 27 17:49:44.624183 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.623904 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-serving-cert\") pod \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " Jul 27 17:49:44.624183 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.623980 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-trusted-ca-bundle\") pod \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " Jul 27 17:49:44.624183 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.624019 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-oauth-serving-cert\") pod \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " Jul 27 17:49:44.624183 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.624102 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-oauth-config\") pod \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\" (UID: \"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1\") " Jul 27 17:49:44.624414 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.624292 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-service-ca" (OuterVolumeSpecName: "service-ca") pod "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" (UID: "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:49:44.624414 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.624330 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-config" (OuterVolumeSpecName: "console-config") pod "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" (UID: "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:49:44.624414 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.624409 2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-service-ca\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:44.624558 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.624519 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" (UID: "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:49:44.624735 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.624674 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" (UID: "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:49:44.626360 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.626315 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-kube-api-access-hfpgj" (OuterVolumeSpecName: "kube-api-access-hfpgj") pod "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" (UID: "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1"). InnerVolumeSpecName "kube-api-access-hfpgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:49:44.626464 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.626326 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" (UID: "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:49:44.626464 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.626400 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" (UID: "0508d0ce-56d4-4cc7-ab9d-cada12fd32f1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:49:44.725237 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.725184 2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-trusted-ca-bundle\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:44.725237 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.725230 2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-oauth-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:44.725237 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.725240 2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-oauth-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:44.725237 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.725248 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfpgj\" (UniqueName: \"kubernetes.io/projected/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-kube-api-access-hfpgj\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:44.725537 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.725260 2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:44.725537 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:44.725268 2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1-console-serving-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:49:45.352117 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.352080 2585 generic.go:356] "Generic (PLEG): container finished" podID="0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" containerID="c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1" exitCode=0 Jul 27 17:49:45.352595 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.352125 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c469fd87f-b757d" Jul 27 17:49:45.352595 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.352140 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c469fd87f-b757d" event={"ID":"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1","Type":"ContainerDied","Data":"c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1"} Jul 27 17:49:45.352595 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.352193 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c469fd87f-b757d" event={"ID":"0508d0ce-56d4-4cc7-ab9d-cada12fd32f1","Type":"ContainerDied","Data":"0b959cbb814c2f05ff48d29b5ee4a02eb6b9f6fee2e9ca422af07887ba1d1dba"} Jul 27 17:49:45.352595 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.352223 2585 scope.go:117] "RemoveContainer" containerID="c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1" Jul 27 17:49:45.361252 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.361234 2585 scope.go:117] "RemoveContainer" containerID="c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1" Jul 27 17:49:45.361515 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:49:45.361495 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1\": container with ID starting with c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1 not found: ID does not exist" containerID="c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1" Jul 27 17:49:45.361583 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.361522 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1"} err="failed to get container status \"c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1\": rpc error: code = NotFound desc = could not find container \"c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1\": container with ID starting with c5d9d5c0d417a56fdda18368b73398d65b094b7e46bb8650a300679b63007cf1 not found: ID does not exist" Jul 27 17:49:45.373031 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.373005 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c469fd87f-b757d"] Jul 27 17:49:45.380113 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.380089 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c469fd87f-b757d"] Jul 27 17:49:45.405591 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:49:45.405559 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" path="/var/lib/kubelet/pods/0508d0ce-56d4-4cc7-ab9d-cada12fd32f1/volumes" Jul 27 17:50:09.824666 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:09.824624 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:09.918293 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:09.918256 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:45.851581 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:45.851538 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:46.622737 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:46.622672 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:46.729233 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:46.729198 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:49.466666 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:49.466630 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:49.547026 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:49.546987 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:51.869426 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:51.869382 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:52.033500 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:52.033458 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:54.176569 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.176533 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:54.311524 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.311497 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:54.412198 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.412163 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:50:54.451997 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.451922 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k67nx"] Jul 27 17:50:54.452292 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.452280 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" containerName="console" Jul 27 17:50:54.452332 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.452295 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" containerName="console" Jul 27 17:50:54.452332 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.452310 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37950396-bb52-4219-9408-e396bb14d013" containerName="console" Jul 27 17:50:54.452332 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.452315 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="37950396-bb52-4219-9408-e396bb14d013" containerName="console" Jul 27 17:50:54.452463 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.452378 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="37950396-bb52-4219-9408-e396bb14d013" containerName="console" Jul 27 17:50:54.452463 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.452390 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="0508d0ce-56d4-4cc7-ab9d-cada12fd32f1" containerName="console" Jul 27 17:50:54.455105 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.455088 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:54.457601 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.457579 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 27 17:50:54.457708 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.457649 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2tv5z\"" Jul 27 17:50:54.458551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.458536 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 27 17:50:54.464275 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.464253 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k67nx"] Jul 27 17:50:54.544455 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.544412 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbkcj\" (UniqueName: \"kubernetes.io/projected/d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e-kube-api-access-bbkcj\") pod \"cert-manager-webhook-6486ffd997-k67nx\" (UID: \"d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:54.544625 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.544528 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k67nx\" (UID: \"d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:54.645647 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.645613 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbkcj\" (UniqueName: \"kubernetes.io/projected/d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e-kube-api-access-bbkcj\") pod \"cert-manager-webhook-6486ffd997-k67nx\" (UID: \"d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:54.645851 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.645705 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k67nx\" (UID: \"d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:54.657053 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.657020 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbkcj\" (UniqueName: \"kubernetes.io/projected/d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e-kube-api-access-bbkcj\") pod \"cert-manager-webhook-6486ffd997-k67nx\" (UID: \"d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:54.657263 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.657246 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k67nx\" (UID: \"d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:54.689734 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.689699 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2q45r"] Jul 27 17:50:54.692226 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.692210 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" Jul 27 17:50:54.694766 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.694745 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-n8275\"" Jul 27 17:50:54.702277 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.702219 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2q45r"] Jul 27 17:50:54.746444 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.746403 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjwmd\" (UniqueName: \"kubernetes.io/projected/00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b-kube-api-access-sjwmd\") pod \"cert-manager-cainjector-559cdd8c87-2q45r\" (UID: \"00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" Jul 27 17:50:54.746626 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.746495 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2q45r\" (UID: \"00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" Jul 27 17:50:54.775305 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.775268 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:54.847563 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.847531 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2q45r\" (UID: \"00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" Jul 27 17:50:54.847716 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.847601 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjwmd\" (UniqueName: \"kubernetes.io/projected/00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b-kube-api-access-sjwmd\") pod \"cert-manager-cainjector-559cdd8c87-2q45r\" (UID: \"00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" Jul 27 17:50:54.857586 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.857234 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjwmd\" (UniqueName: \"kubernetes.io/projected/00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b-kube-api-access-sjwmd\") pod \"cert-manager-cainjector-559cdd8c87-2q45r\" (UID: \"00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" Jul 27 17:50:54.857822 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.857797 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2q45r\" (UID: \"00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" Jul 27 17:50:54.906462 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:54.906437 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k67nx"] Jul 27 17:50:54.908883 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:50:54.908856 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd23ab4ce_7b70_4fc9_9ec5_7fa60e39f77e.slice/crio-15b74f978be28bf6bdd76d3dc21368572822dd2792fa45524c190a465b45cfe4 WatchSource:0}: Error finding container 15b74f978be28bf6bdd76d3dc21368572822dd2792fa45524c190a465b45cfe4: Status 404 returned error can't find the container with id 15b74f978be28bf6bdd76d3dc21368572822dd2792fa45524c190a465b45cfe4 Jul 27 17:50:55.001966 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:55.001883 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" Jul 27 17:50:55.133302 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:55.133271 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2q45r"] Jul 27 17:50:55.136184 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:50:55.136159 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00bf4613_a2f1_4d63_bbbc_2f5a0eb4fa9b.slice/crio-b3aa0b7ab63c29502aa97bf0139031e188557c716c93f747bb69f448fa9984da WatchSource:0}: Error finding container b3aa0b7ab63c29502aa97bf0139031e188557c716c93f747bb69f448fa9984da: Status 404 returned error can't find the container with id b3aa0b7ab63c29502aa97bf0139031e188557c716c93f747bb69f448fa9984da Jul 27 17:50:55.633868 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:55.633750 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" event={"ID":"00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b","Type":"ContainerStarted","Data":"b3aa0b7ab63c29502aa97bf0139031e188557c716c93f747bb69f448fa9984da"} Jul 27 17:50:55.635304 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:55.635276 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" event={"ID":"d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e","Type":"ContainerStarted","Data":"15b74f978be28bf6bdd76d3dc21368572822dd2792fa45524c190a465b45cfe4"} Jul 27 17:50:58.652658 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:58.652613 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" event={"ID":"00bf4613-a2f1-4d63-bbbc-2f5a0eb4fa9b","Type":"ContainerStarted","Data":"4e4b3abb256ea10c2274417b0fbbaa7ee9631dd3247a510274f5fe6a5e0be499"} Jul 27 17:50:58.654198 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:58.654168 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" event={"ID":"d23ab4ce-7b70-4fc9-9ec5-7fa60e39f77e","Type":"ContainerStarted","Data":"2d3bf853e4a44cf79402d427c95e15523d726972015b9f5cc130d7996dc9c502"} Jul 27 17:50:58.654316 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:58.654216 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:50:58.671378 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:58.671315 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2q45r" podStartSLOduration=1.5257533140000001 podStartE2EDuration="4.671299746s" totalImagesPullingTime="3.145546432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:50:58.670493683 +0000 UTC m=+263.820620712" watchObservedRunningTime="2026-07-27 17:50:58.671299746 +0000 UTC m=+263.821426748" Jul 27 17:50:58.689168 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:58.689117 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" podStartSLOduration=1.326210556 podStartE2EDuration="4.689100002s" totalImagesPullingTime="3.362889446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:50:58.688248479 +0000 UTC m=+263.838375485" watchObservedRunningTime="2026-07-27 17:50:58.689100002 +0000 UTC m=+263.839227002" Jul 27 17:50:59.070870 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:50:59.070837 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:01.211722 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:01.211682 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:02.083522 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:02.083491 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:04.660832 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:04.660798 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k67nx" Jul 27 17:51:07.065124 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:07.065085 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:07.162162 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:07.162113 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:13.502049 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:13.502009 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:18.674116 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:18.674079 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:18.769489 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:18.769455 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:28.178209 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:28.178168 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:29.822662 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:29.822628 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:32.937114 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:32.937079 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:33.038406 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:33.038375 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:51:35.234314 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:35.234287 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-acl-logging/0.log" Jul 27 17:51:35.238056 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:35.238032 2585 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 17:51:35.247765 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:51:35.247736 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-acl-logging/0.log" Jul 27 17:52:26.414742 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:52:26.414657 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:52:26.517759 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:52:26.517725 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:52:26.598654 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:52:26.598619 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:52:32.213712 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:52:32.213674 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:53:19.092307 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:19.092257 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:53:19.195579 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:19.195541 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:53:21.369464 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.369425 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:53:21.369895 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.369876 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb"] Jul 27 17:53:21.372799 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.372782 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.375243 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.375208 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 27 17:53:21.375407 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.375279 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 17:53:21.375407 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.375366 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 27 17:53:21.376271 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.376251 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 17:53:21.376419 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.376402 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-vch44\"" Jul 27 17:53:21.381894 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.381874 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb"] Jul 27 17:53:21.502243 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.502186 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.502483 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.502287 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.502483 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.502318 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpnf7\" (UniqueName: \"kubernetes.io/projected/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kube-api-access-dpnf7\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.603162 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.603117 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.603162 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.603161 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpnf7\" (UniqueName: \"kubernetes.io/projected/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kube-api-access-dpnf7\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.603414 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.603228 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.603917 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.603897 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.605682 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.605664 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.610820 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.610791 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpnf7\" (UniqueName: \"kubernetes.io/projected/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kube-api-access-dpnf7\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.683096 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.683000 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:21.819561 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.819537 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb"] Jul 27 17:53:21.821829 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:53:21.821792 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8bd3cf2_ec79_4d8a_8a0b_13e3efa74f5d.slice/crio-e63fcb3a77d854c53432dc9399367c885a2789dd5864f48215b7a583402d2129 WatchSource:0}: Error finding container e63fcb3a77d854c53432dc9399367c885a2789dd5864f48215b7a583402d2129: Status 404 returned error can't find the container with id e63fcb3a77d854c53432dc9399367c885a2789dd5864f48215b7a583402d2129 Jul 27 17:53:21.823755 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.823743 2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 17:53:21.948560 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:21.948449 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:53:22.239248 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:22.239153 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" event={"ID":"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d","Type":"ContainerStarted","Data":"e63fcb3a77d854c53432dc9399367c885a2789dd5864f48215b7a583402d2129"} Jul 27 17:53:25.146043 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:25.146009 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:53:25.253750 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:25.253715 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" event={"ID":"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d","Type":"ContainerStarted","Data":"5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61"} Jul 27 17:53:25.253926 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:25.253800 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:25.272842 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:25.272782 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" podStartSLOduration=1.8671140899999998 podStartE2EDuration="4.272760344s" totalImagesPullingTime="2.405646254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:53:25.2712742 +0000 UTC m=+410.421401201" watchObservedRunningTime="2026-07-27 17:53:25.272760344 +0000 UTC m=+410.422887344" Jul 27 17:53:41.263981 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:41.263945 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:53:42.117496 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.117460 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:53:42.130628 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.130600 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9bp44"] Jul 27 17:53:42.134293 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.134277 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" Jul 27 17:53:42.137412 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.137390 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dngln\"" Jul 27 17:53:42.142603 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.142579 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9bp44"] Jul 27 17:53:42.188114 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.188075 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mtpj\" (UniqueName: \"kubernetes.io/projected/e005c05f-0470-43ab-a20b-55a93b6da6b7-kube-api-access-9mtpj\") pod \"test-trainjob-workflow-node-0-0-9bp44\" (UID: \"e005c05f-0470-43ab-a20b-55a93b6da6b7\") " pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" Jul 27 17:53:42.288745 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.288705 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mtpj\" (UniqueName: \"kubernetes.io/projected/e005c05f-0470-43ab-a20b-55a93b6da6b7-kube-api-access-9mtpj\") pod \"test-trainjob-workflow-node-0-0-9bp44\" (UID: \"e005c05f-0470-43ab-a20b-55a93b6da6b7\") " pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" Jul 27 17:53:42.297919 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.297884 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mtpj\" (UniqueName: \"kubernetes.io/projected/e005c05f-0470-43ab-a20b-55a93b6da6b7-kube-api-access-9mtpj\") pod \"test-trainjob-workflow-node-0-0-9bp44\" (UID: \"e005c05f-0470-43ab-a20b-55a93b6da6b7\") " pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" Jul 27 17:53:42.444487 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.444399 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" Jul 27 17:53:42.575258 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:42.575234 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9bp44"] Jul 27 17:53:42.577535 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:53:42.577506 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode005c05f_0470_43ab_a20b_55a93b6da6b7.slice/crio-f7683c79637e43b9fbf69abe18232e48b3f8a98d0a32628d54a15bc20417f312 WatchSource:0}: Error finding container f7683c79637e43b9fbf69abe18232e48b3f8a98d0a32628d54a15bc20417f312: Status 404 returned error can't find the container with id f7683c79637e43b9fbf69abe18232e48b3f8a98d0a32628d54a15bc20417f312 Jul 27 17:53:43.333577 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:43.333533 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" event={"ID":"e005c05f-0470-43ab-a20b-55a93b6da6b7","Type":"ContainerStarted","Data":"f7683c79637e43b9fbf69abe18232e48b3f8a98d0a32628d54a15bc20417f312"} Jul 27 17:53:43.450789 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:43.450751 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:53:43.506954 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:53:43.506916 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:54:51.674938 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:51.674887 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" event={"ID":"e005c05f-0470-43ab-a20b-55a93b6da6b7","Type":"ContainerStarted","Data":"b275ae6d224f71650cbd4fd07851b2c7543a3657981d0f994d9a735ad0479f8b"} Jul 27 17:54:51.692308 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:51.692253 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" podStartSLOduration=1.428104368 podStartE2EDuration="1m9.692235435s" totalImagesPullingTime="1m8.264131067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:54:51.691095898 +0000 UTC m=+496.841222912" watchObservedRunningTime="2026-07-27 17:54:51.692235435 +0000 UTC m=+496.842362437" Jul 27 17:54:54.691045 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:54.691006 2585 generic.go:356] "Generic (PLEG): container finished" podID="e005c05f-0470-43ab-a20b-55a93b6da6b7" containerID="b275ae6d224f71650cbd4fd07851b2c7543a3657981d0f994d9a735ad0479f8b" exitCode=0 Jul 27 17:54:54.691471 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:54.691080 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" event={"ID":"e005c05f-0470-43ab-a20b-55a93b6da6b7","Type":"ContainerDied","Data":"b275ae6d224f71650cbd4fd07851b2c7543a3657981d0f994d9a735ad0479f8b"} Jul 27 17:54:55.853610 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:55.853573 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" Jul 27 17:54:56.008597 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:56.008510 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mtpj\" (UniqueName: \"kubernetes.io/projected/e005c05f-0470-43ab-a20b-55a93b6da6b7-kube-api-access-9mtpj\") pod \"e005c05f-0470-43ab-a20b-55a93b6da6b7\" (UID: \"e005c05f-0470-43ab-a20b-55a93b6da6b7\") " Jul 27 17:54:56.010828 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:56.010802 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e005c05f-0470-43ab-a20b-55a93b6da6b7-kube-api-access-9mtpj" (OuterVolumeSpecName: "kube-api-access-9mtpj") pod "e005c05f-0470-43ab-a20b-55a93b6da6b7" (UID: "e005c05f-0470-43ab-a20b-55a93b6da6b7"). InnerVolumeSpecName "kube-api-access-9mtpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:54:56.109467 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:56.109432 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mtpj\" (UniqueName: \"kubernetes.io/projected/e005c05f-0470-43ab-a20b-55a93b6da6b7-kube-api-access-9mtpj\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:54:56.701918 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:56.701877 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" event={"ID":"e005c05f-0470-43ab-a20b-55a93b6da6b7","Type":"ContainerDied","Data":"f7683c79637e43b9fbf69abe18232e48b3f8a98d0a32628d54a15bc20417f312"} Jul 27 17:54:56.701918 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:56.701915 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-9bp44" Jul 27 17:54:56.702251 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:56.701926 2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7683c79637e43b9fbf69abe18232e48b3f8a98d0a32628d54a15bc20417f312" Jul 27 17:54:57.382706 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:57.382671 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9bp44"] Jul 27 17:54:57.384922 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:57.384894 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-9bp44"] Jul 27 17:54:57.401736 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:57.401703 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e005c05f-0470-43ab-a20b-55a93b6da6b7" path="/var/lib/kubelet/pods/e005c05f-0470-43ab-a20b-55a93b6da6b7/volumes" Jul 27 17:54:57.413646 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:54:57.413617 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:55:06.436500 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.436466 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb"] Jul 27 17:55:06.437016 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.436633 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" podUID="d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" containerName="manager" containerID="cri-o://5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61" gracePeriod=30 Jul 27 17:55:06.447284 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.447258 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:55:06.549505 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.549475 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:55:06.658190 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.658160 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:55:06.690059 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.689997 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:55:06.722757 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.722723 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:55:06.744126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.744090 2585 generic.go:356] "Generic (PLEG): container finished" podID="d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" containerID="5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61" exitCode=0 Jul 27 17:55:06.744281 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.744137 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" Jul 27 17:55:06.744281 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.744140 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" event={"ID":"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d","Type":"ContainerDied","Data":"5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61"} Jul 27 17:55:06.744281 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.744191 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb" event={"ID":"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d","Type":"ContainerDied","Data":"e63fcb3a77d854c53432dc9399367c885a2789dd5864f48215b7a583402d2129"} Jul 27 17:55:06.744281 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.744213 2585 scope.go:117] "RemoveContainer" containerID="5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61" Jul 27 17:55:06.754318 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.754298 2585 scope.go:117] "RemoveContainer" containerID="5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61" Jul 27 17:55:06.754637 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:55:06.754617 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61\": container with ID starting with 5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61 not found: ID does not exist" containerID="5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61" Jul 27 17:55:06.754702 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.754654 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61"} err="failed to get container status \"5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61\": rpc error: code = NotFound desc = could not find container \"5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61\": container with ID starting with 5a7fecedc588aaef39ee5250395ae00655e6432fc0068f1cfa917a0688f93a61 not found: ID does not exist" Jul 27 17:55:06.800897 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.800866 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kubeflow-trainer-config\") pod \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " Jul 27 17:55:06.800897 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.800901 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpnf7\" (UniqueName: \"kubernetes.io/projected/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kube-api-access-dpnf7\") pod \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " Jul 27 17:55:06.801119 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.800970 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-cert\") pod \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\" (UID: \"d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d\") " Jul 27 17:55:06.803121 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.803087 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kube-api-access-dpnf7" (OuterVolumeSpecName: "kube-api-access-dpnf7") pod "d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" (UID: "d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d"). InnerVolumeSpecName "kube-api-access-dpnf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:55:06.803217 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.803132 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-cert" (OuterVolumeSpecName: "cert") pod "d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" (UID: "d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:55:06.805932 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.805907 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" (UID: "d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:55:06.902002 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.901962 2585 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-cert\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:55:06.902002 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.901991 2585 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kubeflow-trainer-config\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:55:06.902002 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:06.902006 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpnf7\" (UniqueName: \"kubernetes.io/projected/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d-kube-api-access-dpnf7\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:55:07.065410 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.065376 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb"] Jul 27 17:55:07.068866 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.068840 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-5wnbb"] Jul 27 17:55:07.401754 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.401719 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" path="/var/lib/kubelet/pods/d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d/volumes" Jul 27 17:55:07.632896 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.632860 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6bx4j/must-gather-w675n"] Jul 27 17:55:07.633239 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.633188 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" containerName="manager" Jul 27 17:55:07.633239 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.633201 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" containerName="manager" Jul 27 17:55:07.633239 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.633217 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e005c05f-0470-43ab-a20b-55a93b6da6b7" containerName="node" Jul 27 17:55:07.633239 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.633223 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e005c05f-0470-43ab-a20b-55a93b6da6b7" containerName="node" Jul 27 17:55:07.633393 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.633277 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e005c05f-0470-43ab-a20b-55a93b6da6b7" containerName="node" Jul 27 17:55:07.633393 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.633289 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8bd3cf2-ec79-4d8a-8a0b-13e3efa74f5d" containerName="manager" Jul 27 17:55:07.636159 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.636141 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:55:07.639991 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.639972 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6bx4j\"/\"kube-root-ca.crt\"" Jul 27 17:55:07.640153 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.640014 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6bx4j\"/\"default-dockercfg-rxww2\"" Jul 27 17:55:07.640330 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.640310 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6bx4j\"/\"openshift-service-ca.crt\"" Jul 27 17:55:07.648282 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.648258 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6bx4j/must-gather-w675n"] Jul 27 17:55:07.651679 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.651650 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:55:07.712140 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.712051 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2275e3ef-500c-4080-b0b8-9040c1376a54-must-gather-output\") pod \"must-gather-w675n\" (UID: \"2275e3ef-500c-4080-b0b8-9040c1376a54\") " pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:55:07.712140 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.712118 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s74fh\" (UniqueName: \"kubernetes.io/projected/2275e3ef-500c-4080-b0b8-9040c1376a54-kube-api-access-s74fh\") pod \"must-gather-w675n\" (UID: \"2275e3ef-500c-4080-b0b8-9040c1376a54\") " pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:55:07.768666 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.768633 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:55:07.812608 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.812572 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2275e3ef-500c-4080-b0b8-9040c1376a54-must-gather-output\") pod \"must-gather-w675n\" (UID: \"2275e3ef-500c-4080-b0b8-9040c1376a54\") " pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:55:07.812763 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.812644 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s74fh\" (UniqueName: \"kubernetes.io/projected/2275e3ef-500c-4080-b0b8-9040c1376a54-kube-api-access-s74fh\") pod \"must-gather-w675n\" (UID: \"2275e3ef-500c-4080-b0b8-9040c1376a54\") " pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:55:07.813018 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.813000 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2275e3ef-500c-4080-b0b8-9040c1376a54-must-gather-output\") pod \"must-gather-w675n\" (UID: \"2275e3ef-500c-4080-b0b8-9040c1376a54\") " pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:55:07.821312 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.821280 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s74fh\" (UniqueName: \"kubernetes.io/projected/2275e3ef-500c-4080-b0b8-9040c1376a54-kube-api-access-s74fh\") pod \"must-gather-w675n\" (UID: \"2275e3ef-500c-4080-b0b8-9040c1376a54\") " pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:55:07.945646 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:07.945614 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:55:08.076513 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:08.076483 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6bx4j/must-gather-w675n"] Jul 27 17:55:08.079166 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:55:08.079139 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2275e3ef_500c_4080_b0b8_9040c1376a54.slice/crio-e30e9b9acd1870a085ecfabe864b17d9eb8d16b69098445fc21d53d636f6c388 WatchSource:0}: Error finding container e30e9b9acd1870a085ecfabe864b17d9eb8d16b69098445fc21d53d636f6c388: Status 404 returned error can't find the container with id e30e9b9acd1870a085ecfabe864b17d9eb8d16b69098445fc21d53d636f6c388 Jul 27 17:55:08.760124 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:08.760071 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bx4j/must-gather-w675n" event={"ID":"2275e3ef-500c-4080-b0b8-9040c1376a54","Type":"ContainerStarted","Data":"e30e9b9acd1870a085ecfabe864b17d9eb8d16b69098445fc21d53d636f6c388"} Jul 27 17:55:15.797097 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:15.797024 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bx4j/must-gather-w675n" event={"ID":"2275e3ef-500c-4080-b0b8-9040c1376a54","Type":"ContainerStarted","Data":"514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da"} Jul 27 17:55:15.797097 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:15.797071 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bx4j/must-gather-w675n" event={"ID":"2275e3ef-500c-4080-b0b8-9040c1376a54","Type":"ContainerStarted","Data":"079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450"} Jul 27 17:55:15.814061 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:15.814001 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6bx4j/must-gather-w675n" podStartSLOduration=1.791071531 podStartE2EDuration="8.813984518s" totalImagesPullingTime="7.022912987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:55:15.812386482 +0000 UTC m=+520.962513481" watchObservedRunningTime="2026-07-27 17:55:15.813984518 +0000 UTC m=+520.964111519" Jul 27 17:55:26.998597 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:55:26.998510 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:56:01.010073 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:01.009987 2585 generic.go:356] "Generic (PLEG): container finished" podID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerID="079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450" exitCode=0 Jul 27 17:56:01.010073 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:01.010059 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6bx4j/must-gather-w675n" event={"ID":"2275e3ef-500c-4080-b0b8-9040c1376a54","Type":"ContainerDied","Data":"079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450"} Jul 27 17:56:01.010497 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:01.010402 2585 scope.go:117] "RemoveContainer" containerID="079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450" Jul 27 17:56:01.776946 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:01.776919 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6bx4j_must-gather-w675n_2275e3ef-500c-4080-b0b8-9040c1376a54/gather/0.log" Jul 27 17:56:02.138710 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:02.138671 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:56:03.826302 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:03.826254 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:56:05.013932 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:05.013902 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cn72p_c647f46c-9b00-443b-83b9-42d76ed6b23d/global-pull-secret-syncer/0.log" Jul 27 17:56:05.097189 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:05.097158 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" Jul 27 17:56:05.223980 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:05.223955 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-79.ec2.internal_9ed7cbd15715a6bdb7dcea8103b7a8dc/haproxy/0.log" Jul 27 17:56:07.120115 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.120082 2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6bx4j/must-gather-w675n"] Jul 27 17:56:07.120559 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.120268 2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-6bx4j/must-gather-w675n" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerName="copy" containerID="cri-o://514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da" gracePeriod=2 Jul 27 17:56:07.125160 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.125131 2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6bx4j/must-gather-w675n"] Jul 27 17:56:07.361316 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.361294 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6bx4j_must-gather-w675n_2275e3ef-500c-4080-b0b8-9040c1376a54/copy/0.log" Jul 27 17:56:07.363966 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.363947 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:56:07.366190 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:56:07.366167 2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-w675n\" is forbidden: User \"system:node:ip-10-0-133-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6bx4j\": no relationship found between node 'ip-10-0-133-79.ec2.internal' and this object" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:56:07.484111 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.484021 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2275e3ef-500c-4080-b0b8-9040c1376a54-must-gather-output\") pod \"2275e3ef-500c-4080-b0b8-9040c1376a54\" (UID: \"2275e3ef-500c-4080-b0b8-9040c1376a54\") " Jul 27 17:56:07.484111 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.484073 2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s74fh\" (UniqueName: \"kubernetes.io/projected/2275e3ef-500c-4080-b0b8-9040c1376a54-kube-api-access-s74fh\") pod \"2275e3ef-500c-4080-b0b8-9040c1376a54\" (UID: \"2275e3ef-500c-4080-b0b8-9040c1376a54\") " Jul 27 17:56:07.485384 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.485358 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2275e3ef-500c-4080-b0b8-9040c1376a54-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2275e3ef-500c-4080-b0b8-9040c1376a54" (UID: "2275e3ef-500c-4080-b0b8-9040c1376a54"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 17:56:07.486471 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.486451 2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2275e3ef-500c-4080-b0b8-9040c1376a54-kube-api-access-s74fh" (OuterVolumeSpecName: "kube-api-access-s74fh") pod "2275e3ef-500c-4080-b0b8-9040c1376a54" (UID: "2275e3ef-500c-4080-b0b8-9040c1376a54"). InnerVolumeSpecName "kube-api-access-s74fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:56:07.585023 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.584988 2585 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2275e3ef-500c-4080-b0b8-9040c1376a54-must-gather-output\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:56:07.585023 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.585016 2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s74fh\" (UniqueName: \"kubernetes.io/projected/2275e3ef-500c-4080-b0b8-9040c1376a54-kube-api-access-s74fh\") on node \"ip-10-0-133-79.ec2.internal\" DevicePath \"\"" Jul 27 17:56:07.807886 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.807854 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:56:07.909562 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:07.909526 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:56:08.040004 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.039971 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6bx4j_must-gather-w675n_2275e3ef-500c-4080-b0b8-9040c1376a54/copy/0.log" Jul 27 17:56:08.040380 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.040332 2585 generic.go:356] "Generic (PLEG): container finished" podID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerID="514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da" exitCode=143 Jul 27 17:56:08.040477 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.040402 2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6bx4j/must-gather-w675n" Jul 27 17:56:08.040528 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.040407 2585 scope.go:117] "RemoveContainer" containerID="514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da" Jul 27 17:56:08.049150 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.049130 2585 scope.go:117] "RemoveContainer" containerID="079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450" Jul 27 17:56:08.061522 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.061509 2585 scope.go:117] "RemoveContainer" containerID="514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da" Jul 27 17:56:08.061785 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:56:08.061764 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da\": container with ID starting with 514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da not found: ID does not exist" containerID="514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da" Jul 27 17:56:08.061835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.061798 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da"} err="failed to get container status \"514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da\": rpc error: code = NotFound desc = could not find container \"514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da\": container with ID starting with 514bf963e7c4810bf4e156b0036d7fc42cb051c8afc54ba57b1e4063a63a86da not found: ID does not exist" Jul 27 17:56:08.061835 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.061819 2585 scope.go:117] "RemoveContainer" containerID="079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450" Jul 27 17:56:08.062069 ip-10-0-133-79 kubenswrapper[2585]: E0727 17:56:08.062047 2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450\": container with ID starting with 079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450 not found: ID does not exist" containerID="079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450" Jul 27 17:56:08.062108 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.062077 2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450"} err="failed to get container status \"079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450\": rpc error: code = NotFound desc = could not find container \"079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450\": container with ID starting with 079eea7244bad9e4c57481ec5720b56f4e3254430cdd5aba88ca80b886813450 not found: ID does not exist" Jul 27 17:56:08.867473 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.867445 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c4b79c11-917e-4c13-bf1c-ac3d8236ee19/alertmanager/0.log" Jul 27 17:56:08.905541 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.905480 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c4b79c11-917e-4c13-bf1c-ac3d8236ee19/config-reloader/0.log" Jul 27 17:56:08.992457 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:08.992387 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c4b79c11-917e-4c13-bf1c-ac3d8236ee19/kube-rbac-proxy-web/0.log" Jul 27 17:56:09.036206 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.036179 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c4b79c11-917e-4c13-bf1c-ac3d8236ee19/kube-rbac-proxy/0.log" Jul 27 17:56:09.065040 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.065009 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c4b79c11-917e-4c13-bf1c-ac3d8236ee19/kube-rbac-proxy-metric/0.log" Jul 27 17:56:09.097441 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.097416 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c4b79c11-917e-4c13-bf1c-ac3d8236ee19/prom-label-proxy/0.log" Jul 27 17:56:09.127234 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.127207 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c4b79c11-917e-4c13-bf1c-ac3d8236ee19/init-config-reloader/0.log" Jul 27 17:56:09.303658 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.303588 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vdg9q_4aa08fdc-2c37-4137-a8c1-2c5bba73ae51/kube-state-metrics/0.log" Jul 27 17:56:09.326748 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.326719 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vdg9q_4aa08fdc-2c37-4137-a8c1-2c5bba73ae51/kube-rbac-proxy-main/0.log" Jul 27 17:56:09.354551 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.354525 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-vdg9q_4aa08fdc-2c37-4137-a8c1-2c5bba73ae51/kube-rbac-proxy-self/0.log" Jul 27 17:56:09.384143 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.384116 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55744fd7cc-sn5ff_8c286d71-546c-421e-bf23-61c51b2041ee/metrics-server/0.log" Jul 27 17:56:09.401731 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.401695 2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" path="/var/lib/kubelet/pods/2275e3ef-500c-4080-b0b8-9040c1376a54/volumes" Jul 27 17:56:09.410197 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.410176 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-h4kcv_ab7d48ae-a640-4c5b-80e2-a5b2471f1fa8/monitoring-plugin/0.log" Jul 27 17:56:09.441762 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.441737 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djjww_944f00e9-208e-412a-9d83-086aac74f68d/node-exporter/0.log" Jul 27 17:56:09.467575 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.467550 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djjww_944f00e9-208e-412a-9d83-086aac74f68d/kube-rbac-proxy/0.log" Jul 27 17:56:09.499209 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.499185 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-djjww_944f00e9-208e-412a-9d83-086aac74f68d/init-textfile/0.log" Jul 27 17:56:09.701848 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.701821 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-q88lw_c51caf32-86e6-46f3-9427-0adcc1b01cec/kube-rbac-proxy-main/0.log" Jul 27 17:56:09.729495 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.729469 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-q88lw_c51caf32-86e6-46f3-9427-0adcc1b01cec/kube-rbac-proxy-self/0.log" Jul 27 17:56:09.760882 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.760856 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-q88lw_c51caf32-86e6-46f3-9427-0adcc1b01cec/openshift-state-metrics/0.log" Jul 27 17:56:09.796444 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.796422 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2baeb8e-0f71-48a1-89ac-c3b43d117c90/prometheus/0.log" Jul 27 17:56:09.817849 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.817821 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2baeb8e-0f71-48a1-89ac-c3b43d117c90/config-reloader/0.log" Jul 27 17:56:09.841450 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.841421 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2baeb8e-0f71-48a1-89ac-c3b43d117c90/thanos-sidecar/0.log" Jul 27 17:56:09.867102 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.867078 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2baeb8e-0f71-48a1-89ac-c3b43d117c90/kube-rbac-proxy-web/0.log" Jul 27 17:56:09.892995 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.892970 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2baeb8e-0f71-48a1-89ac-c3b43d117c90/kube-rbac-proxy/0.log" Jul 27 17:56:09.916940 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.916911 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2baeb8e-0f71-48a1-89ac-c3b43d117c90/kube-rbac-proxy-thanos/0.log" Jul 27 17:56:09.941707 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.941685 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e2baeb8e-0f71-48a1-89ac-c3b43d117c90/init-config-reloader/0.log" Jul 27 17:56:09.971630 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.971550 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-r8grc_9796a2a8-a78f-462a-ae75-3348615f50ee/prometheus-operator/0.log" Jul 27 17:56:09.994327 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:09.994302 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-r8grc_9796a2a8-a78f-462a-ae75-3348615f50ee/kube-rbac-proxy/0.log" Jul 27 17:56:10.156530 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:10.156499 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd89c97d-r6ct8_c99ef2d2-2bdf-45a7-a406-cdd788d9addc/thanos-query/0.log" Jul 27 17:56:10.194191 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:10.194167 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd89c97d-r6ct8_c99ef2d2-2bdf-45a7-a406-cdd788d9addc/kube-rbac-proxy-web/0.log" Jul 27 17:56:10.230186 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:10.230116 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd89c97d-r6ct8_c99ef2d2-2bdf-45a7-a406-cdd788d9addc/kube-rbac-proxy/0.log" Jul 27 17:56:10.279462 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:10.279411 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd89c97d-r6ct8_c99ef2d2-2bdf-45a7-a406-cdd788d9addc/prom-label-proxy/0.log" Jul 27 17:56:10.367972 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:10.367917 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd89c97d-r6ct8_c99ef2d2-2bdf-45a7-a406-cdd788d9addc/kube-rbac-proxy-rules/0.log" Jul 27 17:56:10.452923 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:10.452887 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69dd89c97d-r6ct8_c99ef2d2-2bdf-45a7-a406-cdd788d9addc/kube-rbac-proxy-metrics/0.log" Jul 27 17:56:12.300778 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.300741 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d5b76c4d8-bbghh_ca16e8dd-af66-4c9a-9dda-7af6079d7cb5/console/0.log" Jul 27 17:56:12.447152 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.447114 2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j"] Jul 27 17:56:12.447493 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.447480 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerName="gather" Jul 27 17:56:12.447540 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.447495 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerName="gather" Jul 27 17:56:12.447540 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.447513 2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerName="copy" Jul 27 17:56:12.447540 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.447518 2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerName="copy" Jul 27 17:56:12.447637 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.447582 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerName="gather" Jul 27 17:56:12.447637 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.447590 2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2275e3ef-500c-4080-b0b8-9040c1376a54" containerName="copy" Jul 27 17:56:12.452902 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.452878 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.455518 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.455498 2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fg5h7\"/\"default-dockercfg-9v8bp\"" Jul 27 17:56:12.455677 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.455539 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fg5h7\"/\"openshift-service-ca.crt\"" Jul 27 17:56:12.455751 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.455723 2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fg5h7\"/\"kube-root-ca.crt\"" Jul 27 17:56:12.460089 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.459816 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j"] Jul 27 17:56:12.530792 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.530752 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-sys\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.530978 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.530804 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dxhr\" (UniqueName: \"kubernetes.io/projected/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-kube-api-access-9dxhr\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.530978 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.530876 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-podres\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.530978 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.530950 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-lib-modules\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.531089 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.531014 2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-proc\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.631992 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.631946 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-lib-modules\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.632099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.632015 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-proc\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.632099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.632041 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-sys\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.632099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.632068 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dxhr\" (UniqueName: \"kubernetes.io/projected/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-kube-api-access-9dxhr\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.632099 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.632095 2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-podres\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.632282 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.632134 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-lib-modules\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.632282 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.632155 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-sys\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.632282 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.632155 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-proc\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.632282 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.632191 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-podres\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.640795 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.640772 2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dxhr\" (UniqueName: \"kubernetes.io/projected/73e78e70-3ac6-4bdf-b0ab-ef728b00e14f-kube-api-access-9dxhr\") pod \"perf-node-gather-daemonset-85v4j\" (UID: \"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f\") " pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.763649 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.763609 2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:12.890618 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:12.890538 2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j"] Jul 27 17:56:12.893256 ip-10-0-133-79 kubenswrapper[2585]: W0727 17:56:12.893232 2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod73e78e70_3ac6_4bdf_b0ab_ef728b00e14f.slice/crio-6beed11b721e9a4fa9844e5a80dc0e1fae209bfd5316b4f5b95945158acfa824 WatchSource:0}: Error finding container 6beed11b721e9a4fa9844e5a80dc0e1fae209bfd5316b4f5b95945158acfa824: Status 404 returned error can't find the container with id 6beed11b721e9a4fa9844e5a80dc0e1fae209bfd5316b4f5b95945158acfa824 Jul 27 17:56:13.063322 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:13.063278 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" event={"ID":"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f","Type":"ContainerStarted","Data":"225784143fb559a1de4270bb07fd1e28cd748f867e0a845f22f4764a2bdb3fa7"} Jul 27 17:56:13.063508 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:13.063416 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:13.063508 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:13.063446 2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" event={"ID":"73e78e70-3ac6-4bdf-b0ab-ef728b00e14f","Type":"ContainerStarted","Data":"6beed11b721e9a4fa9844e5a80dc0e1fae209bfd5316b4f5b95945158acfa824"} Jul 27 17:56:13.079923 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:13.079871 2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" podStartSLOduration=1.079853558 podStartE2EDuration="1.079853558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:56:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:56:13.078770216 +0000 UTC m=+578.228897218" watchObservedRunningTime="2026-07-27 17:56:13.079853558 +0000 UTC m=+578.229980562" Jul 27 17:56:13.646311 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:13.646275 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88xth_9f415abf-1a5d-479c-a2f1-65e937dbebd6/dns/0.log" Jul 27 17:56:13.666645 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:13.666619 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88xth_9f415abf-1a5d-479c-a2f1-65e937dbebd6/kube-rbac-proxy/0.log" Jul 27 17:56:13.736502 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:13.736473 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dk8ws_8c72460a-0686-4ef6-a5d4-29f408a9b0ce/dns-node-resolver/0.log" Jul 27 17:56:14.156814 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:14.156779 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4rd4p_59b068a7-7e63-4ac8-b8a7-328304640f51/node-ca/0.log" Jul 27 17:56:15.292011 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:15.291986 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hmsqh_d9e6286a-567a-4956-bb69-675ae72d9898/serve-healthcheck-canary/0.log" Jul 27 17:56:15.676374 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:15.676328 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7b6z_71dac001-885d-41e5-a8b4-63c6dee5d673/kube-rbac-proxy/0.log" Jul 27 17:56:15.696977 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:15.696950 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7b6z_71dac001-885d-41e5-a8b4-63c6dee5d673/exporter/0.log" Jul 27 17:56:15.720626 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:15.720602 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f7b6z_71dac001-885d-41e5-a8b4-63c6dee5d673/extractor/0.log" Jul 27 17:56:19.078833 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:19.078803 2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fg5h7/perf-node-gather-daemonset-85v4j" Jul 27 17:56:22.168975 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.168941 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4z7sf_927ef834-1155-464c-8f29-8c08c7988908/kube-multus/0.log" Jul 27 17:56:22.379525 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.379451 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlpr7_09e5958a-b65d-4dca-aa79-a8aa6542ba0b/kube-multus-additional-cni-plugins/0.log" Jul 27 17:56:22.399981 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.399958 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlpr7_09e5958a-b65d-4dca-aa79-a8aa6542ba0b/egress-router-binary-copy/0.log" Jul 27 17:56:22.420146 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.420125 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlpr7_09e5958a-b65d-4dca-aa79-a8aa6542ba0b/cni-plugins/0.log" Jul 27 17:56:22.441169 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.441149 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlpr7_09e5958a-b65d-4dca-aa79-a8aa6542ba0b/bond-cni-plugin/0.log" Jul 27 17:56:22.464079 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.464056 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlpr7_09e5958a-b65d-4dca-aa79-a8aa6542ba0b/routeoverride-cni/0.log" Jul 27 17:56:22.486088 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.486066 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlpr7_09e5958a-b65d-4dca-aa79-a8aa6542ba0b/whereabouts-cni-bincopy/0.log" Jul 27 17:56:22.507483 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.507459 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlpr7_09e5958a-b65d-4dca-aa79-a8aa6542ba0b/whereabouts-cni/0.log" Jul 27 17:56:22.780208 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.780129 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xmb7v_7fdc6818-a0a9-4b91-a91f-a077f73273f0/network-metrics-daemon/0.log" Jul 27 17:56:22.802994 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:22.802969 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xmb7v_7fdc6818-a0a9-4b91-a91f-a077f73273f0/kube-rbac-proxy/0.log" Jul 27 17:56:23.274290 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.274254 2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42gjx_41fa3362-3d22-4cd9-b5e6-cf1778ea8c02/konnectivity-agent/0.log" limit=1024 Jul 27 17:56:23.618092 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.618063 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-controller/0.log" Jul 27 17:56:23.641048 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.641019 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-acl-logging/0.log" Jul 27 17:56:23.641179 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.641024 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovn-acl-logging/1.log" Jul 27 17:56:23.661676 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.661655 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/kube-rbac-proxy-node/0.log" Jul 27 17:56:23.685794 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.685753 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 17:56:23.707202 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.707170 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/northd/0.log" Jul 27 17:56:23.728126 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.728099 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/nbdb/0.log" Jul 27 17:56:23.758798 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.758773 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/sbdb/0.log" Jul 27 17:56:23.796862 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:23.796828 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-55xcz_f3fd385d-fd3f-4275-b7de-520e63ca583e/ovnkube-controller/0.log" Jul 27 17:56:25.258052 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:25.258023 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hdpfk_190af8d8-eec3-4faa-89dc-0b26abc43221/network-check-target-container/0.log" Jul 27 17:56:26.240374 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:26.240331 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rh4dx_e80149e4-bbab-4642-9e5d-f79ddbf3a41b/iptables-alerter/0.log" Jul 27 17:56:26.859125 ip-10-0-133-79 kubenswrapper[2585]: I0727 17:56:26.859100 2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hgz6z_26973888-256a-4027-8636-d0a422085792/tuned/0.log"