Aug 05 12:18:54.909818 ip-10-0-129-192 systemd[1]: Starting Kubernetes Kubelet... Aug 05 12:18:55.302258 ip-10-0-129-192 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 12:18:55.302258 ip-10-0-129-192 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 05 12:18:55.302258 ip-10-0-129-192 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 12:18:55.302258 ip-10-0-129-192 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 05 12:18:55.302258 ip-10-0-129-192 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 12:18:55.303977 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.303858 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 05 12:18:55.310367 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310343 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 12:18:55.310367 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310362 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 12:18:55.310367 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310368 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 12:18:55.310367 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310372 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310376 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310381 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310385 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310388 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310392 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310395 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310398 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310401 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310404 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310407 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310410 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310413 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310415 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310418 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310421 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310425 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310428 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310431 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 12:18:55.310547 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310434 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310437 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310440 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310443 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310446 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310449 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310452 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310454 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310457 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310459 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310462 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310464 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310467 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310470 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310472 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310475 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310478 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310481 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310483 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310486 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 12:18:55.311026 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310489 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310491 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310494 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310497 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310499 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310502 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310504 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310507 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310509 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310513 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310516 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310518 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310521 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310524 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310526 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310529 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310532 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310535 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310537 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 12:18:55.311517 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310540 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310543 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310545 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310548 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310564 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310567 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310570 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310573 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310576 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310578 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310581 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310584 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310586 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310590 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310592 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310595 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310598 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310600 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310603 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310605 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 12:18:55.312027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310608 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310610 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310615 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310619 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310623 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310626 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310629 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310632 2560 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310635 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310639 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310642 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310645 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310648 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310650 2560 feature_gate.go:328] unrecognized feature gate: Example Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310653 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310656 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310658 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.310661 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311362 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311368 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 12:18:55.312548 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311371 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311374 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311377 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311380 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311383 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311385 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311388 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311391 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311394 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311396 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311399 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311402 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311405 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311407 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311410 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311413 2560 feature_gate.go:328] unrecognized feature gate: Example Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311416 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311419 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311422 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311424 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 12:18:55.313077 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311427 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311430 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311433 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311436 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311438 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311441 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311444 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311452 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311454 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311457 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311459 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311462 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311464 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311467 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311470 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311472 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311475 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311478 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311480 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311483 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 12:18:55.313586 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311485 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311488 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311491 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311493 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311497 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311499 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311502 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311504 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311508 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311511 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311514 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311519 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311522 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311527 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311530 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311533 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311537 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311540 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311543 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 12:18:55.314080 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311546 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311548 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311565 2560 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311568 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311571 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311573 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311576 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311578 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311581 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311584 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311586 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311589 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311592 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311594 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311597 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311599 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311602 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311605 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311607 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311610 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 12:18:55.314541 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311614 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311618 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311622 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311625 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311627 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311631 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311633 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311636 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311638 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311642 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311646 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311649 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311652 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311654 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311657 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311660 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311663 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.311665 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312036 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312040 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 12:18:55.315055 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312043 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312046 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312048 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312051 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312054 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312057 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312059 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312062 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312065 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312068 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312071 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312073 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312076 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312081 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312084 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312087 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312090 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312093 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312095 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312098 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 12:18:55.315570 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312101 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312104 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312106 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312109 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312113 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312117 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312120 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312123 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312126 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312130 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312132 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312135 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312138 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312140 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312143 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312146 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312148 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312151 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312153 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 12:18:55.316079 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312156 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312159 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312162 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312165 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312167 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312170 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312173 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312176 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312185 2560 feature_gate.go:328] unrecognized feature gate: Example Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312188 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312191 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312194 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312196 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312199 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312201 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312204 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312206 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312209 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312211 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312214 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 12:18:55.316537 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312216 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312219 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312221 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312224 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312227 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312230 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312232 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312235 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312237 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312241 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312244 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312246 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312249 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312251 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312254 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312257 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312259 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312262 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312266 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312269 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 12:18:55.317076 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312272 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312276 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312280 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312283 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312286 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312290 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312294 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312296 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312299 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312302 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312304 2560 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312307 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312309 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312312 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312314 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312317 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312319 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.312322 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312393 2560 flags.go:64] FLAG: --address="0.0.0.0" Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312400 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 05 12:18:55.317609 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312407 2560 flags.go:64] FLAG: --anonymous-auth="true" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312411 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312415 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312418 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312422 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312426 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312429 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312432 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312436 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312440 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312445 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312448 2560 flags.go:64] FLAG: --cgroup-root="" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312451 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312455 2560 flags.go:64] FLAG: --client-ca-file="" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312459 2560 flags.go:64] FLAG: --cloud-provider="external" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312462 2560 flags.go:64] FLAG: --cluster-dns="[]" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312466 2560 flags.go:64] FLAG: --cluster-domain="" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312469 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312472 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312475 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312478 2560 flags.go:64] FLAG: --container-log-max-files="5" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312482 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312485 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 05 12:18:55.318092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312488 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312492 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312495 2560 flags.go:64] FLAG: --contention-profiling="false" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312498 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312501 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312504 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312507 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312511 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312514 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312517 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312520 2560 flags.go:64] FLAG: --enable-load-reader="false" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312523 2560 flags.go:64] FLAG: --enable-server="true" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312526 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312530 2560 flags.go:64] FLAG: --event-burst="100" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312534 2560 flags.go:64] FLAG: --event-qps="50" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312537 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312539 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312542 2560 flags.go:64] FLAG: --eviction-hard="" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312546 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312563 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312567 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312570 2560 flags.go:64] FLAG: --eviction-soft="" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312574 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312577 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312581 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 05 12:18:55.318662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312584 2560 flags.go:64] FLAG: --experimental-mounter-path="" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312587 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312590 2560 flags.go:64] FLAG: --fail-swap-on="true" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312593 2560 flags.go:64] FLAG: --feature-gates="" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312597 2560 flags.go:64] FLAG: --file-check-frequency="20s" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312600 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312603 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312606 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312609 2560 flags.go:64] FLAG: --healthz-port="10248" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312612 2560 flags.go:64] FLAG: --help="false" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312615 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-129-192.ec2.internal" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312618 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312621 2560 flags.go:64] FLAG: --http-check-frequency="20s" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312624 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312627 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312631 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312633 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312636 2560 flags.go:64] FLAG: --image-service-endpoint="" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312639 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312642 2560 flags.go:64] FLAG: --kube-api-burst="100" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312645 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312648 2560 flags.go:64] FLAG: --kube-api-qps="50" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312651 2560 flags.go:64] FLAG: --kube-reserved="" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312654 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 05 12:18:55.319284 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312656 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312659 2560 flags.go:64] FLAG: --kubelet-cgroups="" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312663 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312666 2560 flags.go:64] FLAG: --lock-file="" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312669 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312672 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312675 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312680 2560 flags.go:64] FLAG: --log-json-split-stream="false" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312686 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312689 2560 flags.go:64] FLAG: --log-text-split-stream="false" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312692 2560 flags.go:64] FLAG: --logging-format="text" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312695 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312698 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312701 2560 flags.go:64] FLAG: --manifest-url="" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312704 2560 flags.go:64] FLAG: --manifest-url-header="" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312708 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312711 2560 flags.go:64] FLAG: --max-open-files="1000000" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312715 2560 flags.go:64] FLAG: --max-pods="110" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312718 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312721 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312724 2560 flags.go:64] FLAG: --memory-manager-policy="None" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312727 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312730 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312733 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312736 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 05 12:18:55.320174 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312743 2560 flags.go:64] FLAG: --node-status-max-images="50" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312746 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312749 2560 flags.go:64] FLAG: --oom-score-adj="-999" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312752 2560 flags.go:64] FLAG: --pod-cidr="" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312755 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312760 2560 flags.go:64] FLAG: --pod-manifest-path="" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312763 2560 flags.go:64] FLAG: --pod-max-pids="-1" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312766 2560 flags.go:64] FLAG: --pods-per-core="0" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312769 2560 flags.go:64] FLAG: --port="10250" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312772 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312775 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0417bb98af3711f22" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312779 2560 flags.go:64] FLAG: --qos-reserved="" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312782 2560 flags.go:64] FLAG: --read-only-port="10255" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312786 2560 flags.go:64] FLAG: --register-node="true" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312789 2560 flags.go:64] FLAG: --register-with-taints="" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312793 2560 flags.go:64] FLAG: --registry-burst="10" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312796 2560 flags.go:64] FLAG: --registry-qps="5" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312799 2560 flags.go:64] FLAG: --reserved-cpus="" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312803 2560 flags.go:64] FLAG: --reserved-memory="" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312806 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312809 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312812 2560 flags.go:64] FLAG: --rotate-certificates="false" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312823 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312826 2560 flags.go:64] FLAG: --runonce="false" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312829 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 05 12:18:55.321367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312833 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312836 2560 flags.go:64] FLAG: --seccomp-default="false" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312839 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312842 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312845 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312848 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312851 2560 flags.go:64] FLAG: --storage-driver-password="root" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312854 2560 flags.go:64] FLAG: --storage-driver-secure="false" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312857 2560 flags.go:64] FLAG: --storage-driver-table="stats" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312860 2560 flags.go:64] FLAG: --storage-driver-user="root" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312863 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312866 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312868 2560 flags.go:64] FLAG: --system-cgroups="" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312871 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312877 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312880 2560 flags.go:64] FLAG: --tls-cert-file="" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312883 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312886 2560 flags.go:64] FLAG: --tls-min-version="" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312889 2560 flags.go:64] FLAG: --tls-private-key-file="" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312892 2560 flags.go:64] FLAG: --topology-manager-policy="none" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312895 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312898 2560 flags.go:64] FLAG: --topology-manager-scope="container" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312901 2560 flags.go:64] FLAG: --v="2" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312904 2560 flags.go:64] FLAG: --version="false" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312909 2560 flags.go:64] FLAG: --vmodule="" Aug 05 12:18:55.322366 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312912 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.312916 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313029 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313034 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313037 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313040 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313042 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313045 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313047 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313050 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313052 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313055 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313058 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313060 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313063 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313066 2560 feature_gate.go:328] unrecognized feature gate: Example Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313068 2560 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313071 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313073 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313076 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 12:18:55.323019 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313079 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313082 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313084 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313087 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313089 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313092 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313095 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313097 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313100 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313102 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313104 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313107 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313110 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313113 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313115 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313117 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313120 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313122 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313125 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 12:18:55.323884 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313127 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313132 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313134 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313137 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313139 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313142 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313144 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313148 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313151 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313153 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313157 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313159 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313161 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313164 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313167 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313169 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313172 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313174 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313177 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313179 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 12:18:55.324689 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313182 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313184 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313188 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313192 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313195 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313197 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313200 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313203 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313205 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313208 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313210 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313213 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313215 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313220 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313222 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313225 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313228 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313230 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313233 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 12:18:55.325335 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313238 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313242 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313245 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313248 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313251 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313254 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313257 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313260 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313263 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313266 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313269 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313272 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313274 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313277 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313280 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313282 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313286 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313289 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313291 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313295 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 12:18:55.325966 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313298 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313301 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.313304 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.314175 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.322084 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.322103 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.322969 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.322985 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323105 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323114 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323119 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323124 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323129 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323134 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323139 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 12:18:55.326484 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323144 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323149 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323154 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323158 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323162 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323167 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323171 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323176 2560 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323179 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323184 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323188 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323192 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323197 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323201 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323208 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323214 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323220 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323232 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323239 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 12:18:55.326896 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323245 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323250 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323255 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323260 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323265 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323269 2560 feature_gate.go:328] unrecognized feature gate: Example Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323273 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323277 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323282 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323286 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323290 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323294 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323299 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323304 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323308 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323312 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323316 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323320 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323325 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323329 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 12:18:55.327698 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323334 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323339 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323343 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323347 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323351 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323356 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323360 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323364 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323369 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323372 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323376 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323388 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323393 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323398 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323402 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323407 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323411 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323415 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323420 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323424 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 12:18:55.328339 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323428 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323432 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323437 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323441 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323445 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323450 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323454 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323458 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323462 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323467 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323471 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323475 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323479 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323483 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323488 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323494 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323499 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323504 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323509 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 12:18:55.328987 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323514 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323518 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323522 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323526 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323530 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323542 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323547 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323567 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323572 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323577 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323581 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323586 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323590 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323593 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.323602 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 12:18:55.329467 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323821 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323829 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323834 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323838 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323843 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323852 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323858 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323863 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323867 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323871 2560 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323875 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323879 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323883 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323887 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323891 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323895 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323899 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323903 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323907 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323911 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 12:18:55.329863 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323915 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323919 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323924 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323939 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323945 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323950 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323955 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323960 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323964 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323968 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323973 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323977 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323982 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323986 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323990 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323994 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.323998 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324002 2560 feature_gate.go:328] unrecognized feature gate: Example Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324007 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324011 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 12:18:55.330407 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324015 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324020 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324024 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324028 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324032 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324036 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324040 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324044 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324049 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324053 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324058 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324062 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324066 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324070 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324074 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324078 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324090 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324095 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324100 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324104 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 12:18:55.330992 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324108 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324113 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324117 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324121 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324125 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324129 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324134 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324138 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324142 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324146 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324150 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324154 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324158 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324162 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324167 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324171 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324175 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324180 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324184 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324188 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 12:18:55.331485 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324193 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324197 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324201 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324205 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324209 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324214 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324225 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324229 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324233 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324249 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324255 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324260 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324264 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324268 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324272 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324279 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324284 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324288 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 12:18:55.332157 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:55.324293 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 12:18:55.332829 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.324301 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 12:18:55.332829 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.324458 2560 server.go:962] "Client rotation is on, will bootstrap in background" Aug 05 12:18:55.332829 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.328596 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 05 12:18:55.332829 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.330011 2560 server.go:1019] "Starting client certificate rotation" Aug 05 12:18:55.332829 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.330139 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 12:18:55.332829 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.330173 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 12:18:55.333813 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.333798 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 12:18:55.335310 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.335282 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 12:18:55.342918 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.342900 2560 log.go:25] "Validated CRI v1 runtime API" Aug 05 12:18:55.344849 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.344836 2560 log.go:25] "Validated CRI v1 image API" Aug 05 12:18:55.346135 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.346122 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 05 12:18:55.349276 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.349256 2560 fs.go:135] Filesystem UUIDs: map[28a5f432-6ecc-43a5-ba45-43b6dca82654:/dev/nvme0n1p4 675d078f-a2d9-4f7f-be61-33d59308b44b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Aug 05 12:18:55.349347 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.349275 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 05 12:18:55.354277 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.354163 2560 manager.go:216] Machine: {Timestamp:2026-08-05 12:18:55.353042078 +0000 UTC m=+0.325456769 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098514 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cf5723a69cc3813047daa817b3cbe SystemUUID:ec2cf572-3a69-cc38-1304-7daa817b3cbe BootID:12cc868f-d631-466c-849d-de3d651b683f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:f1:2d:13:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:f1:2d:13:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:a8:f3:42:ac:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 05 12:18:55.354277 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.354272 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 05 12:18:55.354386 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.354368 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 05 12:18:55.356704 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.356686 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 12:18:55.357122 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.357092 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 05 12:18:55.357287 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.357127 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 05 12:18:55.358247 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.358233 2560 topology_manager.go:138] "Creating topology manager with none policy" Aug 05 12:18:55.358302 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.358254 2560 container_manager_linux.go:309] "Creating device plugin manager" Aug 05 12:18:55.358302 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.358265 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 12:18:55.358915 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.358903 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 12:18:55.359686 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.359675 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 05 12:18:55.363134 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363120 2560 state_mem.go:36] "Initialized new in-memory state store" Aug 05 12:18:55.363300 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363288 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 05 12:18:55.363369 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363336 2560 kubelet.go:486] "Attempting to sync node with API server" Aug 05 12:18:55.363369 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363357 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 05 12:18:55.363460 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363372 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 05 12:18:55.363460 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363385 2560 kubelet.go:398] "Adding apiserver pod source" Aug 05 12:18:55.363460 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363454 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 05 12:18:55.363875 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363861 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 12:18:55.363937 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.363888 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 12:18:55.366102 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.366083 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 05 12:18:55.367440 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.367423 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 05 12:18:55.367518 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.367462 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 05 12:18:55.370256 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370242 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 05 12:18:55.370325 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370278 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 05 12:18:55.370325 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370288 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 05 12:18:55.370325 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370297 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 05 12:18:55.370325 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370310 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 05 12:18:55.370325 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370318 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 05 12:18:55.370548 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370331 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 05 12:18:55.370548 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370339 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 05 12:18:55.370548 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370350 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 05 12:18:55.370548 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370358 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 05 12:18:55.370548 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370378 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 05 12:18:55.370548 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.370388 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 05 12:18:55.371088 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.371076 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 05 12:18:55.371135 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.371091 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 05 12:18:55.372744 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:55.372719 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 05 12:18:55.372867 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:55.372846 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 05 12:18:55.373046 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.373029 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 05 12:18:55.374257 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.374242 2560 server.go:1268] "Started kubelet" Aug 05 12:18:55.374350 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.374321 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 05 12:18:55.374486 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.374315 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 05 12:18:55.374530 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.374509 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 05 12:18:55.375051 ip-10-0-129-192 systemd[1]: Started Kubernetes Kubelet. Aug 05 12:18:55.379091 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.379065 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 05 12:18:55.380398 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.380381 2560 server.go:310] "Adding debug handlers to kubelet server" Aug 05 12:18:55.381446 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:55.381425 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 05 12:18:55.385418 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.385387 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5qhkw" Aug 05 12:18:55.387092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.387075 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 05 12:18:55.387158 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.387087 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 05 12:18:55.387243 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:55.387224 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:55.388010 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.387778 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 05 12:18:55.388010 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.387857 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 05 12:18:55.388010 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.387871 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 05 12:18:55.388010 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.388007 2560 reconstruct.go:97] "Volume reconstruction finished" Aug 05 12:18:55.388214 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.388017 2560 reconciler.go:29] "Reconciler: start to sync state" Aug 05 12:18:55.388571 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.388302 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 05 12:18:55.388571 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.388319 2560 factory.go:55] Registering systemd factory Aug 05 12:18:55.388571 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.388328 2560 factory.go:223] Registration of the systemd container factory successfully Aug 05 12:18:55.389762 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.389745 2560 factory.go:153] Registering CRI-O factory Aug 05 12:18:55.389842 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.389766 2560 factory.go:223] Registration of the crio container factory successfully Aug 05 12:18:55.389842 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.389789 2560 factory.go:103] Registering Raw factory Aug 05 12:18:55.389842 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.389803 2560 manager.go:1196] Started watching for new ooms in manager Aug 05 12:18:55.390465 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.390449 2560 manager.go:349] Starting recovery of all containers Aug 05 12:18:55.393126 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:55.393099 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 05 12:18:55.393220 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.393142 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5qhkw" Aug 05 12:18:55.393780 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:55.393750 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 05 12:18:55.394627 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:55.393242 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-192.ec2.internal.18c8e7ff2add28e1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-192.ec2.internal,UID:ip-10-0-129-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-192.ec2.internal,},FirstTimestamp:2026-08-05 12:18:55.374215393 +0000 UTC m=+0.346630141,LastTimestamp:2026-08-05 12:18:55.374215393 +0000 UTC m=+0.346630141,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-192.ec2.internal,}" Aug 05 12:18:55.401206 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.401192 2560 manager.go:354] Recovery completed Aug 05 12:18:55.405121 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.405021 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 12:18:55.407142 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.407126 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientMemory" Aug 05 12:18:55.407211 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.407152 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 12:18:55.407211 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.407162 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientPID" Aug 05 12:18:55.407680 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.407666 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 05 12:18:55.407680 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.407678 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 05 12:18:55.407792 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.407693 2560 state_mem.go:36] "Initialized new in-memory state store" Aug 05 12:18:55.407792 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.407706 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 12:18:55.408367 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.408354 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientMemory" Aug 05 12:18:55.408419 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.408380 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 12:18:55.408419 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.408389 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientPID" Aug 05 12:18:55.409047 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.409032 2560 policy_none.go:49] "None policy: Start" Aug 05 12:18:55.409047 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.409049 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 05 12:18:55.409192 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.409059 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 05 12:18:55.410628 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:55.410616 2560 policy_none.go:47] "Start" Aug 05 12:18:55.410956 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:55.409346 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-192.ec2.internal.18c8e7ff2cd38b64 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-192.ec2.internal,UID:ip-10-0-129-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-192.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-192.ec2.internal,},FirstTimestamp:2026-08-05 12:18:55.407139684 +0000 UTC m=+0.379554376,LastTimestamp:2026-08-05 12:18:55.407139684 +0000 UTC m=+0.379554376,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-192.ec2.internal,}" Aug 05 12:18:56.917909 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:56.917892 2560 manager.go:337] "Starting Device Plugin manager" Aug 05 12:18:56.917980 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:56.917926 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 05 12:18:56.917980 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:56.917937 2560 server.go:87] "Starting device plugin registration server" Aug 05 12:18:56.918210 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:56.918198 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 05 12:18:56.918249 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:56.918213 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 05 12:18:56.918539 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:56.918367 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 05 12:18:56.918539 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:56.918455 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 05 12:18:56.918539 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:56.918465 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 05 12:18:56.919051 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:56.919027 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 05 12:18:56.919130 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:56.919088 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.018839 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.018764 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 12:18:57.020095 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.019803 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientMemory" Aug 05 12:18:57.020095 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.019845 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 12:18:57.020095 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.019859 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientPID" Aug 05 12:18:57.020095 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.019893 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.027617 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.027580 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 05 12:18:57.027914 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.027899 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.027976 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.027928 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-192.ec2.internal\": node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.028770 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.028752 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 05 12:18:57.028821 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.028801 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 05 12:18:57.028860 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.028830 2560 kubelet.go:2448] "Starting kubelet main sync loop" Aug 05 12:18:57.028910 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.028871 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 05 12:18:57.030978 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.030957 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 12:18:57.076070 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.076036 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.129687 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.129651 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal"] Aug 05 12:18:57.129856 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.129733 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 12:18:57.130802 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.130785 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientMemory" Aug 05 12:18:57.130903 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.130816 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 12:18:57.130903 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.130830 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientPID" Aug 05 12:18:57.132023 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.132010 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 12:18:57.132147 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.132131 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.132202 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.132162 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 12:18:57.132769 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.132754 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientMemory" Aug 05 12:18:57.132852 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.132779 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 12:18:57.132852 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.132790 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientPID" Aug 05 12:18:57.133379 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.133360 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientMemory" Aug 05 12:18:57.133510 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.133392 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 12:18:57.133510 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.133407 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientPID" Aug 05 12:18:57.133847 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.133834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.133897 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.133859 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 12:18:57.134551 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.134525 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientMemory" Aug 05 12:18:57.134551 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.134551 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 12:18:57.134662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.134569 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeHasSufficientPID" Aug 05 12:18:57.151759 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.151738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085be5e42d0150ff2c7d62ba258a4275-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal\" (UID: \"085be5e42d0150ff2c7d62ba258a4275\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.151862 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.151761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/645b936c36ac9f10f261c827f21930d7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-192.ec2.internal\" (UID: \"645b936c36ac9f10f261c827f21930d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.151862 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.151778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/085be5e42d0150ff2c7d62ba258a4275-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal\" (UID: \"085be5e42d0150ff2c7d62ba258a4275\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.169013 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.168988 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-192.ec2.internal\" not found" node="ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.173546 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.173527 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-192.ec2.internal\" not found" node="ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.176568 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.176553 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.252730 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.252690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/085be5e42d0150ff2c7d62ba258a4275-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal\" (UID: \"085be5e42d0150ff2c7d62ba258a4275\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.252730 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.252728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085be5e42d0150ff2c7d62ba258a4275-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal\" (UID: \"085be5e42d0150ff2c7d62ba258a4275\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.252959 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.252745 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/645b936c36ac9f10f261c827f21930d7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-192.ec2.internal\" (UID: \"645b936c36ac9f10f261c827f21930d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.252959 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.252813 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/085be5e42d0150ff2c7d62ba258a4275-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal\" (UID: \"085be5e42d0150ff2c7d62ba258a4275\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.252959 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.252871 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/645b936c36ac9f10f261c827f21930d7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-192.ec2.internal\" (UID: \"645b936c36ac9f10f261c827f21930d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.252959 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.252912 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/085be5e42d0150ff2c7d62ba258a4275-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal\" (UID: \"085be5e42d0150ff2c7d62ba258a4275\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.277184 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.277104 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.377885 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.377850 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.472400 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.472361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.476895 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.476834 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.477933 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.477912 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.578964 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.578880 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.679360 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.679334 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.762260 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.762234 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 12:18:57.780308 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.780273 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-192.ec2.internal\" not found" Aug 05 12:18:57.791449 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.791427 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 05 12:18:57.791583 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.791564 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 12:18:57.791583 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.791573 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 12:18:57.809260 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.809240 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 12:18:57.825842 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.825821 2560 apiserver.go:52] "Watching apiserver" Aug 05 12:18:57.833165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.833107 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 05 12:18:57.834225 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.834205 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4kmm4","openshift-cluster-node-tuning-operator/tuned-hftm8","openshift-multus/multus-qpgrc","openshift-multus/network-metrics-daemon-wcxrc","openshift-network-diagnostics/network-check-target-6m4tz","openshift-network-operator/iptables-alerter-fvs7p","openshift-ovn-kubernetes/ovnkube-node-q8nkk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52","openshift-dns/node-resolver-glb5w","openshift-image-registry/node-ca-npm29","openshift-multus/multus-additional-cni-plugins-2xcvz","kube-system/global-pull-secret-syncer-kqsfn"] Aug 05 12:18:57.835816 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.835796 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:18:57.836854 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.836838 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.838478 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.838198 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.838601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.838490 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 05 12:18:57.838601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.838520 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 05 12:18:57.838601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.838571 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bsdkp\"" Aug 05 12:18:57.839062 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.839044 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 05 12:18:57.839744 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.839556 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 05 12:18:57.839744 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.839573 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:18:57.839744 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.839683 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:18:57.840014 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.839788 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9zm96\"" Aug 05 12:18:57.840254 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.840236 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 05 12:18:57.841029 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.840995 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:18:57.841436 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.841406 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 05 12:18:57.841529 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.841412 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5c6t\"" Aug 05 12:18:57.841529 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.841402 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:18:57.841640 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.841548 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 05 12:18:57.841640 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.841606 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 05 12:18:57.842785 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.842762 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.844102 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.844086 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.844653 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.844633 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 05 12:18:57.844721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.844673 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 05 12:18:57.844777 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.844721 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t9g26\"" Aug 05 12:18:57.844928 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.844915 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 05 12:18:57.845584 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.845552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.846162 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.846149 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jfmjl\"" Aug 05 12:18:57.846988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.846745 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.846988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.846768 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 05 12:18:57.846988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.846796 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 05 12:18:57.846988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.846811 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 05 12:18:57.846988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.846836 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 05 12:18:57.846988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.846866 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 05 12:18:57.846988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.846813 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 05 12:18:57.847430 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.847414 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 05 12:18:57.847735 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.847721 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 05 12:18:57.847990 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.847975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.848086 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.848067 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 05 12:18:57.848214 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.848112 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-knb6m\"" Aug 05 12:18:57.849325 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.849311 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.849393 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.849331 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 05 12:18:57.849447 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.849439 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.849662 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.849642 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 05 12:18:57.850111 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.850093 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-58wp4\"" Aug 05 12:18:57.850195 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.850099 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 05 12:18:57.850195 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.850098 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 05 12:18:57.850195 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.850138 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 05 12:18:57.850363 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.850202 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 05 12:18:57.850412 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.850394 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-256lv\"" Aug 05 12:18:57.851141 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.851126 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.851189 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.851169 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:18:57.851391 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.851375 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 05 12:18:57.851456 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.851444 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 05 12:18:57.852074 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.852058 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2w2n4\"" Aug 05 12:18:57.856006 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.855854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-var-lib-kubelet\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.856006 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.855880 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86160c72-c49f-4eb5-9484-6f764aeae43b-iptables-alerter-script\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.856006 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.855897 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-slash\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.856006 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.855911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-systemd\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.856006 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.855932 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-cni-bin\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.856006 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.855967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-host\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.856006 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.855990 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6970973f-db5b-4900-8ffa-632c76887ba3-etc-tuned\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6970973f-db5b-4900-8ffa-632c76887ba3-tmp\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856034 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-multus-certs\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856049 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-device-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0474997c-86af-453b-8957-5e3360208078-tmp-dir\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2112b6a-081c-4700-8789-2e82809fdbba-agent-certs\") pod \"konnectivity-agent-4kmm4\" (UID: \"d2112b6a-081c-4700-8789-2e82809fdbba\") " pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-k8s-cni-cncf-io\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856215 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovnkube-config\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856240 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0474997c-86af-453b-8957-5e3360208078-hosts-file\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856264 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl29s\" (UniqueName: \"kubernetes.io/projected/35449318-618e-4493-a22f-388310f5cbae-kube-api-access-wl29s\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856355 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-kubernetes\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.856378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2112b6a-081c-4700-8789-2e82809fdbba-konnectivity-ca\") pod \"konnectivity-agent-4kmm4\" (UID: \"d2112b6a-081c-4700-8789-2e82809fdbba\") " pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856403 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-system-cni-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx8zd\" (UniqueName: \"kubernetes.io/projected/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-kube-api-access-tx8zd\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-os-release\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-run-netns\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856495 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovn-node-metrics-cert\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-cni-bin\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-conf-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856568 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-log-socket\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856586 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-cnibin\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856622 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gvf5\" (UniqueName: \"kubernetes.io/projected/0474997c-86af-453b-8957-5e3360208078-kube-api-access-8gvf5\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-serviceca\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.856818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-run\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-socket-dir-parent\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-etc-kubernetes\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpczt\" (UniqueName: \"kubernetes.io/projected/39b10769-8554-4e57-974f-b625bfa322cf-kube-api-access-qpczt\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856817 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72a568d6-8cc6-4dd4-9c93-2c1393198783-kubelet-config\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-modprobe-d\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-sys\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-cni-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856898 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlrcn\" (UniqueName: \"kubernetes.io/projected/efe6a4fa-c797-48ac-bf89-c201f50c6a82-kube-api-access-xlrcn\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856924 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkcmt\" (UniqueName: \"kubernetes.io/projected/86160c72-c49f-4eb5-9484-6f764aeae43b-kube-api-access-rkcmt\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856942 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-etc-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856956 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.856970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-ovn\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-cni-netd\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857015 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovnkube-script-lib\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efe6a4fa-c797-48ac-bf89-c201f50c6a82-cni-binary-copy\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857050 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-cni-multus\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857078 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blfgb\" (UniqueName: \"kubernetes.io/projected/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-kube-api-access-blfgb\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-run-ovn-kubernetes\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-env-overrides\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-cnibin\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysconfig\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857231 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-netns\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857287 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-hostroot\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-daemon-config\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857352 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86160c72-c49f-4eb5-9484-6f764aeae43b-host-slash\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-systemd-units\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-host\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z26m\" (UniqueName: \"kubernetes.io/projected/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-kube-api-access-5z26m\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-sys-fs\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.857934 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysctl-d\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysctl-conf\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857564 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-systemd\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-var-lib-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857595 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-node-log\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-registration-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857631 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-system-cni-dir\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857660 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857681 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hbth\" (UniqueName: \"kubernetes.io/projected/6970973f-db5b-4900-8ffa-632c76887ba3-kube-api-access-8hbth\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857701 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-os-release\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857715 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-kubelet\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-kubelet\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-socket-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72a568d6-8cc6-4dd4-9c93-2c1393198783-dbus\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.858382 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.857786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-lib-modules\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.860060 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.860025 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 12:13:56 +0000 UTC" deadline="2028-05-01 17:10:48.875149706 +0000 UTC" Aug 05 12:18:57.860103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.860059 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15244h51m51.015092369s" Aug 05 12:18:57.861136 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.861123 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal"] Aug 05 12:18:57.861275 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.861264 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 12:18:57.861335 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.861325 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" Aug 05 12:18:57.863983 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.863967 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 12:18:57.871604 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.871584 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 12:18:57.871698 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.871632 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal"] Aug 05 12:18:57.892387 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.892368 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l56v5" Aug 05 12:18:57.898498 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.898479 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l56v5" Aug 05 12:18:57.950739 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.950721 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 05 12:18:57.958172 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-system-cni-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.958283 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx8zd\" (UniqueName: \"kubernetes.io/projected/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-kube-api-access-tx8zd\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.958283 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-os-release\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.958283 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.958283 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958229 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-run-netns\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.958283 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovn-node-metrics-cert\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.958283 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958267 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958292 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-system-cni-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958322 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-os-release\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958309 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-cni-bin\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958356 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-cni-bin\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-conf-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-log-socket\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-cnibin\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958466 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958504 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gvf5\" (UniqueName: \"kubernetes.io/projected/0474997c-86af-453b-8957-5e3360208078-kube-api-access-8gvf5\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958509 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-serviceca\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958551 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-conf-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958598 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-log-socket\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.958601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958603 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-run-netns\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958729 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-run\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958849 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-run\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958866 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-socket-dir-parent\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-etc-kubernetes\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958918 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpczt\" (UniqueName: \"kubernetes.io/projected/39b10769-8554-4e57-974f-b625bfa322cf-kube-api-access-qpczt\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72a568d6-8cc6-4dd4-9c93-2c1393198783-kubelet-config\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-modprobe-d\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958990 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-sys\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959008 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-socket-dir-parent\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959072 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-cnibin\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959015 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-cni-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959137 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlrcn\" (UniqueName: \"kubernetes.io/projected/efe6a4fa-c797-48ac-bf89-c201f50c6a82-kube-api-access-xlrcn\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkcmt\" (UniqueName: \"kubernetes.io/projected/86160c72-c49f-4eb5-9484-6f764aeae43b-kube-api-access-rkcmt\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959184 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-sys\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959184 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72a568d6-8cc6-4dd4-9c93-2c1393198783-kubelet-config\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.959265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959138 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-cni-dir\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-etc-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959274 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-ovn\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959282 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-etc-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959317 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-cni-netd\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959342 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovnkube-script-lib\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959346 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959283 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-modprobe-d\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efe6a4fa-c797-48ac-bf89-c201f50c6a82-cni-binary-copy\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959373 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-cni-netd\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959343 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-ovn\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.958967 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-etc-kubernetes\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959483 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-cni-multus\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959511 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blfgb\" (UniqueName: \"kubernetes.io/projected/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-kube-api-access-blfgb\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959537 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-run-ovn-kubernetes\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959585 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-env-overrides\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959636 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-cnibin\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysconfig\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-netns\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959699 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-run-ovn-kubernetes\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-hostroot\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959740 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-hostroot\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-daemon-config\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86160c72-c49f-4eb5-9484-6f764aeae43b-host-slash\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-systemd-units\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-host\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959816 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-cni-multus\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959857 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959899 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z26m\" (UniqueName: \"kubernetes.io/projected/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-kube-api-access-5z26m\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-sys-fs\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.959937 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959995 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysconfig\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.960907 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960039 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86160c72-c49f-4eb5-9484-6f764aeae43b-host-slash\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.960053 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs podName:dfd0ac47-bc49-46f0-8848-b17a54c9df3a nodeName:}" failed. No retries permitted until 2026-08-05 12:18:58.460003658 +0000 UTC m=+1.970674705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs") pod "network-metrics-daemon-wcxrc" (UID: "dfd0ac47-bc49-46f0-8848-b17a54c9df3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959748 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960082 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-systemd-units\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960106 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-env-overrides\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959901 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efe6a4fa-c797-48ac-bf89-c201f50c6a82-cni-binary-copy\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960157 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-netns\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.959941 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovnkube-script-lib\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960191 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-sys-fs\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960214 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-host\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960234 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-cnibin\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysctl-d\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960320 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysctl-conf\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.960339 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960359 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-systemd\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-var-lib-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.961766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960408 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-node-log\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960420 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-systemd\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960425 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysctl-d\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960457 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-registration-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.960468 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret podName:72a568d6-8cc6-4dd4-9c93-2c1393198783 nodeName:}" failed. No retries permitted until 2026-08-05 12:18:58.460450559 +0000 UTC m=+1.971121615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret") pod "global-pull-secret-syncer-kqsfn" (UID: "72a568d6-8cc6-4dd4-9c93-2c1393198783") : object "kube-system"/"original-pull-secret" not registered Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960496 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-system-cni-dir\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960512 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-registration-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960528 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-sysctl-conf\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960550 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hbth\" (UniqueName: \"kubernetes.io/projected/6970973f-db5b-4900-8ffa-632c76887ba3-kube-api-access-8hbth\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960558 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-node-log\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960563 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efe6a4fa-c797-48ac-bf89-c201f50c6a82-multus-daemon-config\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960572 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-system-cni-dir\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960616 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-var-lib-openvswitch\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960717 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-os-release\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-kubelet\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.962626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960791 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-kubelet\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960821 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-os-release\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960826 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-serviceca\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-socket-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960859 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72a568d6-8cc6-4dd4-9c93-2c1393198783-dbus\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-lib-modules\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960902 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72a568d6-8cc6-4dd4-9c93-2c1393198783-dbus\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960920 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-var-lib-kubelet\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960951 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-var-lib-kubelet\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86160c72-c49f-4eb5-9484-6f764aeae43b-iptables-alerter-script\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960989 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-kubelet\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-slash\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961002 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-lib-modules\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961010 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-cni-binary-copy\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961024 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-systemd\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.960923 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-socket-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961042 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-slash\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-cni-bin\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961076 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-host\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961081 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-var-lib-kubelet\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961079 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-host-cni-bin\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961097 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35449318-618e-4493-a22f-388310f5cbae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6970973f-db5b-4900-8ffa-632c76887ba3-etc-tuned\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961119 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-run-systemd\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961146 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-host\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6970973f-db5b-4900-8ffa-632c76887ba3-tmp\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-multus-certs\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961267 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-device-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0474997c-86af-453b-8957-5e3360208078-tmp-dir\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961334 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2112b6a-081c-4700-8789-2e82809fdbba-agent-certs\") pod \"konnectivity-agent-4kmm4\" (UID: \"d2112b6a-081c-4700-8789-2e82809fdbba\") " pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-k8s-cni-cncf-io\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961371 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961383 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovnkube-config\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961423 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-multus-certs\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.963962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961454 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0474997c-86af-453b-8957-5e3360208078-hosts-file\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961485 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961553 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86160c72-c49f-4eb5-9484-6f764aeae43b-iptables-alerter-script\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961614 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39b10769-8554-4e57-974f-b625bfa322cf-device-dir\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961644 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35449318-618e-4493-a22f-388310f5cbae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961669 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0474997c-86af-453b-8957-5e3360208078-hosts-file\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961693 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efe6a4fa-c797-48ac-bf89-c201f50c6a82-host-run-k8s-cni-cncf-io\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961704 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl29s\" (UniqueName: \"kubernetes.io/projected/35449318-618e-4493-a22f-388310f5cbae-kube-api-access-wl29s\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961734 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-kubernetes\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961758 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2112b6a-081c-4700-8789-2e82809fdbba-konnectivity-ca\") pod \"konnectivity-agent-4kmm4\" (UID: \"d2112b6a-081c-4700-8789-2e82809fdbba\") " pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961962 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0474997c-86af-453b-8957-5e3360208078-tmp-dir\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.961998 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6970973f-db5b-4900-8ffa-632c76887ba3-etc-kubernetes\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.962121 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovnkube-config\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.962253 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2112b6a-081c-4700-8789-2e82809fdbba-konnectivity-ca\") pod \"konnectivity-agent-4kmm4\" (UID: \"d2112b6a-081c-4700-8789-2e82809fdbba\") " pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.962611 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-ovn-node-metrics-cert\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.963703 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6970973f-db5b-4900-8ffa-632c76887ba3-tmp\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.964032 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6970973f-db5b-4900-8ffa-632c76887ba3-etc-tuned\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.964490 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.964399 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2112b6a-081c-4700-8789-2e82809fdbba-agent-certs\") pod \"konnectivity-agent-4kmm4\" (UID: \"d2112b6a-081c-4700-8789-2e82809fdbba\") " pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:18:57.966265 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.966242 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gvf5\" (UniqueName: \"kubernetes.io/projected/0474997c-86af-453b-8957-5e3360208078-kube-api-access-8gvf5\") pod \"node-resolver-glb5w\" (UID: \"0474997c-86af-453b-8957-5e3360208078\") " pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.966422 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.966408 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx8zd\" (UniqueName: \"kubernetes.io/projected/d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4-kube-api-access-tx8zd\") pod \"node-ca-npm29\" (UID: \"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4\") " pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:57.969867 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.969845 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpczt\" (UniqueName: \"kubernetes.io/projected/39b10769-8554-4e57-974f-b625bfa322cf-kube-api-access-qpczt\") pod \"aws-ebs-csi-driver-node-j9l52\" (UID: \"39b10769-8554-4e57-974f-b625bfa322cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:57.973619 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.973577 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkcmt\" (UniqueName: \"kubernetes.io/projected/86160c72-c49f-4eb5-9484-6f764aeae43b-kube-api-access-rkcmt\") pod \"iptables-alerter-fvs7p\" (UID: \"86160c72-c49f-4eb5-9484-6f764aeae43b\") " pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:57.973619 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.973588 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z26m\" (UniqueName: \"kubernetes.io/projected/d4c83e3a-d7c3-4e67-b81e-bc7af7235da4-kube-api-access-5z26m\") pod \"ovnkube-node-q8nkk\" (UID: \"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4\") " pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:57.974260 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.974242 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blfgb\" (UniqueName: \"kubernetes.io/projected/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-kube-api-access-blfgb\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:18:57.974760 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.974745 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 12:18:57.974810 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.974765 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 12:18:57.974810 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.974776 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9bbx7 for pod openshift-network-diagnostics/network-check-target-6m4tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:18:57.974891 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:57.974820 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7 podName:636d0bb5-96fa-410a-b1c1-c613d11e9a29 nodeName:}" failed. No retries permitted until 2026-08-05 12:18:58.474805598 +0000 UTC m=+1.985476666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9bbx7" (UniqueName: "kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7") pod "network-check-target-6m4tz" (UID: "636d0bb5-96fa-410a-b1c1-c613d11e9a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:18:57.974891 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.974840 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlrcn\" (UniqueName: \"kubernetes.io/projected/efe6a4fa-c797-48ac-bf89-c201f50c6a82-kube-api-access-xlrcn\") pod \"multus-qpgrc\" (UID: \"efe6a4fa-c797-48ac-bf89-c201f50c6a82\") " pod="openshift-multus/multus-qpgrc" Aug 05 12:18:57.977557 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.977537 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hbth\" (UniqueName: \"kubernetes.io/projected/6970973f-db5b-4900-8ffa-632c76887ba3-kube-api-access-8hbth\") pod \"tuned-hftm8\" (UID: \"6970973f-db5b-4900-8ffa-632c76887ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:57.979892 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.979874 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl29s\" (UniqueName: \"kubernetes.io/projected/35449318-618e-4493-a22f-388310f5cbae-kube-api-access-wl29s\") pod \"multus-additional-cni-plugins-2xcvz\" (UID: \"35449318-618e-4493-a22f-388310f5cbae\") " pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:57.980542 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.980518 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-glb5w" Aug 05 12:18:57.996151 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:57.996129 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-npm29" Aug 05 12:18:58.000837 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.000822 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" Aug 05 12:18:58.033464 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.033430 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4bee1f1_ab53_433b_a7d5_8bda5f0d32c4.slice/crio-47f89e7b425d9f93a7292631b3e6d3a559b3848bc80c718b556239964f21ae62 WatchSource:0}: Error finding container 47f89e7b425d9f93a7292631b3e6d3a559b3848bc80c718b556239964f21ae62: Status 404 returned error can't find the container with id 47f89e7b425d9f93a7292631b3e6d3a559b3848bc80c718b556239964f21ae62 Aug 05 12:18:58.033997 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.033978 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35449318_618e_4493_a22f_388310f5cbae.slice/crio-b5bc1efa71ea7b8e65155b4236ceeb6dcf250078911d1acdd0691767fc11d56f WatchSource:0}: Error finding container b5bc1efa71ea7b8e65155b4236ceeb6dcf250078911d1acdd0691767fc11d56f: Status 404 returned error can't find the container with id b5bc1efa71ea7b8e65155b4236ceeb6dcf250078911d1acdd0691767fc11d56f Aug 05 12:18:58.034756 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.034734 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645b936c36ac9f10f261c827f21930d7.slice/crio-ccdd434bf3c6e10c14958aa81829ec697cf4d7cb7e8ba3e86fb21ac04de7da10 WatchSource:0}: Error finding container ccdd434bf3c6e10c14958aa81829ec697cf4d7cb7e8ba3e86fb21ac04de7da10: Status 404 returned error can't find the container with id ccdd434bf3c6e10c14958aa81829ec697cf4d7cb7e8ba3e86fb21ac04de7da10 Aug 05 12:18:58.037224 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.037212 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 12:18:58.059412 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.059385 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085be5e42d0150ff2c7d62ba258a4275.slice/crio-97d51cba6b089ec1f80144024c590ffbf5788173c46c2de7811bcde791ed1828 WatchSource:0}: Error finding container 97d51cba6b089ec1f80144024c590ffbf5788173c46c2de7811bcde791ed1828: Status 404 returned error can't find the container with id 97d51cba6b089ec1f80144024c590ffbf5788173c46c2de7811bcde791ed1828 Aug 05 12:18:58.170691 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.170609 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:18:58.176222 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.176200 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hftm8" Aug 05 12:18:58.179326 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.179278 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2112b6a_081c_4700_8789_2e82809fdbba.slice/crio-997f1c83ca54aaac9a156f2be1fa7637ee0deedee0d40aa259768288eb03e5b8 WatchSource:0}: Error finding container 997f1c83ca54aaac9a156f2be1fa7637ee0deedee0d40aa259768288eb03e5b8: Status 404 returned error can't find the container with id 997f1c83ca54aaac9a156f2be1fa7637ee0deedee0d40aa259768288eb03e5b8 Aug 05 12:18:58.183591 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.183571 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6970973f_db5b_4900_8ffa_632c76887ba3.slice/crio-a827813f11d2074b5e622830874cf6ce81760981e7326cb874938074609e037c WatchSource:0}: Error finding container a827813f11d2074b5e622830874cf6ce81760981e7326cb874938074609e037c: Status 404 returned error can't find the container with id a827813f11d2074b5e622830874cf6ce81760981e7326cb874938074609e037c Aug 05 12:18:58.209022 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.208992 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpgrc" Aug 05 12:18:58.219526 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.219512 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fvs7p" Aug 05 12:18:58.228452 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.228427 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86160c72_c49f_4eb5_9484_6f764aeae43b.slice/crio-1f641ecd18c8099ce5cecb5bbdc694db0d0080ad764975e42635544a89c4dc86 WatchSource:0}: Error finding container 1f641ecd18c8099ce5cecb5bbdc694db0d0080ad764975e42635544a89c4dc86: Status 404 returned error can't find the container with id 1f641ecd18c8099ce5cecb5bbdc694db0d0080ad764975e42635544a89c4dc86 Aug 05 12:18:58.241605 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.241585 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:18:58.242415 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.242397 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 12:18:58.248742 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.248720 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c83e3a_d7c3_4e67_b81e_bc7af7235da4.slice/crio-9fbb25c32a14a22167c79237fdd90e2c26378863b8f36bf57a66ec5f9f1b0475 WatchSource:0}: Error finding container 9fbb25c32a14a22167c79237fdd90e2c26378863b8f36bf57a66ec5f9f1b0475: Status 404 returned error can't find the container with id 9fbb25c32a14a22167c79237fdd90e2c26378863b8f36bf57a66ec5f9f1b0475 Aug 05 12:18:58.262090 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.262071 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" Aug 05 12:18:58.269861 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.269840 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b10769_8554_4e57_974f_b625bfa322cf.slice/crio-e94aa54f633d7a8aaffff496429886a173d524cc40b1b887f9e8b623dda73f08 WatchSource:0}: Error finding container e94aa54f633d7a8aaffff496429886a173d524cc40b1b887f9e8b623dda73f08: Status 404 returned error can't find the container with id e94aa54f633d7a8aaffff496429886a173d524cc40b1b887f9e8b623dda73f08 Aug 05 12:18:58.372907 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:18:58.372880 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0474997c_86af_453b_8957_5e3360208078.slice/crio-0fc5211ba0481b4e22ac880c71a4e23325020d5f14f50e370a03d32a4583ed22 WatchSource:0}: Error finding container 0fc5211ba0481b4e22ac880c71a4e23325020d5f14f50e370a03d32a4583ed22: Status 404 returned error can't find the container with id 0fc5211ba0481b4e22ac880c71a4e23325020d5f14f50e370a03d32a4583ed22 Aug 05 12:18:58.465689 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.465599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:18:58.465689 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.465651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:58.465897 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:58.465799 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 12:18:58.465897 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:58.465860 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret podName:72a568d6-8cc6-4dd4-9c93-2c1393198783 nodeName:}" failed. No retries permitted until 2026-08-05 12:18:59.46584294 +0000 UTC m=+2.976513989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret") pod "global-pull-secret-syncer-kqsfn" (UID: "72a568d6-8cc6-4dd4-9c93-2c1393198783") : object "kube-system"/"original-pull-secret" not registered Aug 05 12:18:58.466228 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:58.466134 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:18:58.466228 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:58.466201 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs podName:dfd0ac47-bc49-46f0-8848-b17a54c9df3a nodeName:}" failed. No retries permitted until 2026-08-05 12:18:59.466183603 +0000 UTC m=+2.976854663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs") pod "network-metrics-daemon-wcxrc" (UID: "dfd0ac47-bc49-46f0-8848-b17a54c9df3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:18:58.566763 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.566721 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:18:58.567018 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:58.566998 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 12:18:58.567108 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:58.567032 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 12:18:58.567108 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:58.567046 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9bbx7 for pod openshift-network-diagnostics/network-check-target-6m4tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:18:58.567108 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:58.567108 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7 podName:636d0bb5-96fa-410a-b1c1-c613d11e9a29 nodeName:}" failed. No retries permitted until 2026-08-05 12:18:59.567088114 +0000 UTC m=+3.077759183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bbx7" (UniqueName: "kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7") pod "network-check-target-6m4tz" (UID: "636d0bb5-96fa-410a-b1c1-c613d11e9a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:18:58.900887 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.900787 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 12:13:57 +0000 UTC" deadline="2028-02-04 17:05:49.776211087 +0000 UTC" Aug 05 12:18:58.900887 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:58.900841 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13156h46m50.875374844s" Aug 05 12:18:59.030688 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.030655 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:59.030861 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.030786 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:18:59.037701 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.037603 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 12:18:59.048949 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.048869 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" event={"ID":"645b936c36ac9f10f261c827f21930d7","Type":"ContainerStarted","Data":"ccdd434bf3c6e10c14958aa81829ec697cf4d7cb7e8ba3e86fb21ac04de7da10"} Aug 05 12:18:59.056388 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.056341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-npm29" event={"ID":"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4","Type":"ContainerStarted","Data":"47f89e7b425d9f93a7292631b3e6d3a559b3848bc80c718b556239964f21ae62"} Aug 05 12:18:59.063623 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.063585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-glb5w" event={"ID":"0474997c-86af-453b-8957-5e3360208078","Type":"ContainerStarted","Data":"0fc5211ba0481b4e22ac880c71a4e23325020d5f14f50e370a03d32a4583ed22"} Aug 05 12:18:59.084891 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.084776 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fvs7p" event={"ID":"86160c72-c49f-4eb5-9484-6f764aeae43b","Type":"ContainerStarted","Data":"1f641ecd18c8099ce5cecb5bbdc694db0d0080ad764975e42635544a89c4dc86"} Aug 05 12:18:59.104815 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.104771 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpgrc" event={"ID":"efe6a4fa-c797-48ac-bf89-c201f50c6a82","Type":"ContainerStarted","Data":"96d509339a0888e1b422f6c022f6e65d27f2b8b1a73f8ff319c559a443ae3284"} Aug 05 12:18:59.123530 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.123492 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hftm8" event={"ID":"6970973f-db5b-4900-8ffa-632c76887ba3","Type":"ContainerStarted","Data":"a827813f11d2074b5e622830874cf6ce81760981e7326cb874938074609e037c"} Aug 05 12:18:59.127135 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.127103 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4kmm4" event={"ID":"d2112b6a-081c-4700-8789-2e82809fdbba","Type":"ContainerStarted","Data":"997f1c83ca54aaac9a156f2be1fa7637ee0deedee0d40aa259768288eb03e5b8"} Aug 05 12:18:59.144115 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.144045 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" event={"ID":"35449318-618e-4493-a22f-388310f5cbae","Type":"ContainerStarted","Data":"b5bc1efa71ea7b8e65155b4236ceeb6dcf250078911d1acdd0691767fc11d56f"} Aug 05 12:18:59.160565 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.160493 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" event={"ID":"39b10769-8554-4e57-974f-b625bfa322cf","Type":"ContainerStarted","Data":"e94aa54f633d7a8aaffff496429886a173d524cc40b1b887f9e8b623dda73f08"} Aug 05 12:18:59.179486 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.179455 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"9fbb25c32a14a22167c79237fdd90e2c26378863b8f36bf57a66ec5f9f1b0475"} Aug 05 12:18:59.188549 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.188519 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" event={"ID":"085be5e42d0150ff2c7d62ba258a4275","Type":"ContainerStarted","Data":"97d51cba6b089ec1f80144024c590ffbf5788173c46c2de7811bcde791ed1828"} Aug 05 12:18:59.475983 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.475902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:18:59.475983 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.475956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:18:59.476190 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.476112 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 12:18:59.476190 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.476179 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret podName:72a568d6-8cc6-4dd4-9c93-2c1393198783 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:01.47615955 +0000 UTC m=+4.986830612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret") pod "global-pull-secret-syncer-kqsfn" (UID: "72a568d6-8cc6-4dd4-9c93-2c1393198783") : object "kube-system"/"original-pull-secret" not registered Aug 05 12:18:59.476636 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.476617 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:18:59.476716 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.476682 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs podName:dfd0ac47-bc49-46f0-8848-b17a54c9df3a nodeName:}" failed. No retries permitted until 2026-08-05 12:19:01.476663984 +0000 UTC m=+4.987335030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs") pod "network-metrics-daemon-wcxrc" (UID: "dfd0ac47-bc49-46f0-8848-b17a54c9df3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:18:59.520179 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.520145 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 12:18:59.577194 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.577162 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:18:59.577400 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.577365 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 12:18:59.577400 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.577386 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 12:18:59.577400 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.577399 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9bbx7 for pod openshift-network-diagnostics/network-check-target-6m4tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:18:59.577564 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:18:59.577455 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7 podName:636d0bb5-96fa-410a-b1c1-c613d11e9a29 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:01.57743808 +0000 UTC m=+5.088109128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bbx7" (UniqueName: "kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7") pod "network-check-target-6m4tz" (UID: "636d0bb5-96fa-410a-b1c1-c613d11e9a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:18:59.901233 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.901117 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 12:13:57 +0000 UTC" deadline="2028-03-23 06:53:43.476030666 +0000 UTC" Aug 05 12:18:59.901233 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:18:59.901184 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14298h34m43.574850841s" Aug 05 12:19:00.029856 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:00.029820 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:00.030046 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:00.029967 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:00.030331 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:00.029820 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:00.030452 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:00.030430 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:01.031751 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:01.031538 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:01.031751 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.031663 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:01.499666 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:01.499588 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:01.499666 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:01.499641 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:01.499875 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.499762 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 12:19:01.499875 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.499823 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret podName:72a568d6-8cc6-4dd4-9c93-2c1393198783 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:05.49980492 +0000 UTC m=+9.010475983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret") pod "global-pull-secret-syncer-kqsfn" (UID: "72a568d6-8cc6-4dd4-9c93-2c1393198783") : object "kube-system"/"original-pull-secret" not registered Aug 05 12:19:01.499875 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.499761 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:19:01.500041 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.499914 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs podName:dfd0ac47-bc49-46f0-8848-b17a54c9df3a nodeName:}" failed. No retries permitted until 2026-08-05 12:19:05.49989518 +0000 UTC m=+9.010566246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs") pod "network-metrics-daemon-wcxrc" (UID: "dfd0ac47-bc49-46f0-8848-b17a54c9df3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:19:01.600477 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:01.600436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:01.601203 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.600654 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 12:19:01.601203 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.600686 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 12:19:01.601203 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.600700 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9bbx7 for pod openshift-network-diagnostics/network-check-target-6m4tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:19:01.601203 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:01.600828 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7 podName:636d0bb5-96fa-410a-b1c1-c613d11e9a29 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:05.600804653 +0000 UTC m=+9.111475722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bbx7" (UniqueName: "kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7") pod "network-check-target-6m4tz" (UID: "636d0bb5-96fa-410a-b1c1-c613d11e9a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:19:02.029805 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:02.029771 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:02.029995 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:02.029926 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:02.030356 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:02.030331 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:02.030460 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:02.030427 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:03.029688 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:03.029653 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:03.030217 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:03.029803 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:04.029436 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:04.029398 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:04.029630 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:04.029529 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:04.029630 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:04.029581 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:04.030122 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:04.029712 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:05.029246 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:05.029210 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:05.029417 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.029361 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:05.529254 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:05.529215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:05.529741 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:05.529267 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:05.529741 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.529345 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:19:05.529741 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.529371 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 12:19:05.529741 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.529409 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs podName:dfd0ac47-bc49-46f0-8848-b17a54c9df3a nodeName:}" failed. No retries permitted until 2026-08-05 12:19:13.529389366 +0000 UTC m=+17.040060430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs") pod "network-metrics-daemon-wcxrc" (UID: "dfd0ac47-bc49-46f0-8848-b17a54c9df3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:19:05.529741 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.529428 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret podName:72a568d6-8cc6-4dd4-9c93-2c1393198783 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:13.529417663 +0000 UTC m=+17.040088713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret") pod "global-pull-secret-syncer-kqsfn" (UID: "72a568d6-8cc6-4dd4-9c93-2c1393198783") : object "kube-system"/"original-pull-secret" not registered Aug 05 12:19:05.629663 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:05.629609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:05.629857 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.629830 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 12:19:05.629857 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.629853 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 12:19:05.629966 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.629867 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9bbx7 for pod openshift-network-diagnostics/network-check-target-6m4tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:19:05.629966 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:05.629924 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7 podName:636d0bb5-96fa-410a-b1c1-c613d11e9a29 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:13.629907266 +0000 UTC m=+17.140578325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bbx7" (UniqueName: "kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7") pod "network-check-target-6m4tz" (UID: "636d0bb5-96fa-410a-b1c1-c613d11e9a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:19:06.029645 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:06.029608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:06.029645 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:06.029634 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:06.029885 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:06.029748 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:06.029945 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:06.029872 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:07.030080 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:07.030053 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:07.030483 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:07.030177 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:08.029171 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:08.029108 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:08.029395 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:08.029242 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:08.029561 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:08.029542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:08.029719 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:08.029672 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:09.029128 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:09.029090 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:09.029621 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:09.029220 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:10.029635 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:10.029601 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:10.030101 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:10.029602 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:10.030101 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:10.029725 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:10.030101 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:10.029808 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:11.029854 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:11.029813 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:11.030280 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:11.029963 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:12.029071 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:12.029033 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:12.029071 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:12.029038 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:12.029329 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:12.029204 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:12.029387 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:12.029349 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:13.030021 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:13.029991 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:13.030484 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.030106 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:13.593142 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:13.593106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:13.593142 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:13.593150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:13.593447 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.593261 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 12:19:13.593447 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.593266 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:19:13.593447 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.593331 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret podName:72a568d6-8cc6-4dd4-9c93-2c1393198783 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:29.593313506 +0000 UTC m=+33.103984553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret") pod "global-pull-secret-syncer-kqsfn" (UID: "72a568d6-8cc6-4dd4-9c93-2c1393198783") : object "kube-system"/"original-pull-secret" not registered Aug 05 12:19:13.593447 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.593353 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs podName:dfd0ac47-bc49-46f0-8848-b17a54c9df3a nodeName:}" failed. No retries permitted until 2026-08-05 12:19:29.593342491 +0000 UTC m=+33.104013536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs") pod "network-metrics-daemon-wcxrc" (UID: "dfd0ac47-bc49-46f0-8848-b17a54c9df3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:19:13.693599 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:13.693567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:13.693767 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.693732 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 12:19:13.693767 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.693751 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 12:19:13.693767 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.693760 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9bbx7 for pod openshift-network-diagnostics/network-check-target-6m4tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:19:13.693914 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:13.693813 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7 podName:636d0bb5-96fa-410a-b1c1-c613d11e9a29 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:29.693796711 +0000 UTC m=+33.204467774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bbx7" (UniqueName: "kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7") pod "network-check-target-6m4tz" (UID: "636d0bb5-96fa-410a-b1c1-c613d11e9a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:19:14.029405 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:14.029319 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:14.029405 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:14.029366 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:14.029624 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:14.029489 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:14.029678 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:14.029619 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:15.029237 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:15.029203 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:15.029713 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:15.029337 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:16.029628 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:16.029597 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:16.029628 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:16.029630 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:16.030116 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:16.029710 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:16.030116 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:16.029845 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:17.029926 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:17.029892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:17.030387 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:17.030017 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:18.029494 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.029317 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:18.029631 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.029375 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:18.029631 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:18.029566 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:18.029720 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:18.029638 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:18.236785 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.236756 2560 generic.go:356] "Generic (PLEG): container finished" podID="35449318-618e-4493-a22f-388310f5cbae" containerID="d7529447181fa3c696f574ba7bc418de76052b5964b33a0bc51b73f772fa9e14" exitCode=0 Aug 05 12:19:18.237489 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.236830 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" event={"ID":"35449318-618e-4493-a22f-388310f5cbae","Type":"ContainerDied","Data":"d7529447181fa3c696f574ba7bc418de76052b5964b33a0bc51b73f772fa9e14"} Aug 05 12:19:18.238350 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.238331 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" event={"ID":"39b10769-8554-4e57-974f-b625bfa322cf","Type":"ContainerStarted","Data":"3c2db50b5f228a7f5d2f1f1cdba041a0041861f79076b2ce1b522045d3edd05d"} Aug 05 12:19:18.241066 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.241044 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:19:18.241408 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.241390 2560 generic.go:356] "Generic (PLEG): container finished" podID="d4c83e3a-d7c3-4e67-b81e-bc7af7235da4" containerID="d814a9113d8575160a947b2cb210ce12cd958dcb0c748dfadf5d994638e14a17" exitCode=1 Aug 05 12:19:18.241475 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.241458 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"1dd37ac642bbee1bc6fcb253355d2a0ae9152ce80c47bf5d0170db161520e098"} Aug 05 12:19:18.241544 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.241528 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"eb8d20cdf6264efdc5eaa358480dbced9d36aeecf0fdb6e2ce526f9188169e35"} Aug 05 12:19:18.241582 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.241570 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"9a7aeaec3132cd33332b595d6e0b75968ea0ba942a912e51c91d5c707454064f"} Aug 05 12:19:18.241620 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.241600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"654a932d92fa3fd42a9f5a534c2d1148b6d330a8f9e4c9a6bb34cfc40001523b"} Aug 05 12:19:18.241655 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.241642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerDied","Data":"d814a9113d8575160a947b2cb210ce12cd958dcb0c748dfadf5d994638e14a17"} Aug 05 12:19:18.241695 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.241677 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"60c73b2650a4c228ccc0a54da4da35e1cec54e15a93507785f1712b4d06a486d"} Aug 05 12:19:18.242967 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.242946 2560 generic.go:356] "Generic (PLEG): container finished" podID="085be5e42d0150ff2c7d62ba258a4275" containerID="17ec6faf24e9ffa8ee58e0b8a42b34d42fe1f96f2528867e46eceb2731cae5b2" exitCode=0 Aug 05 12:19:18.243071 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.243012 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" event={"ID":"085be5e42d0150ff2c7d62ba258a4275","Type":"ContainerDied","Data":"17ec6faf24e9ffa8ee58e0b8a42b34d42fe1f96f2528867e46eceb2731cae5b2"} Aug 05 12:19:18.244398 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.244375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" event={"ID":"645b936c36ac9f10f261c827f21930d7","Type":"ContainerStarted","Data":"5c7153ec900bb491186ac8488bea6ecacbe89c412c250db597a3967b297f8eb8"} Aug 05 12:19:18.245750 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.245729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-npm29" event={"ID":"d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4","Type":"ContainerStarted","Data":"4c341f9adc9b3948dbcc1c4d648f57ca9186ff4560d68891c3542120e6177478"} Aug 05 12:19:18.247074 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.247052 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-glb5w" event={"ID":"0474997c-86af-453b-8957-5e3360208078","Type":"ContainerStarted","Data":"5104bf9267dfd79f56703f3b5cc462cd566625620bf16645261f93a0c9ee9e2f"} Aug 05 12:19:18.248444 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.248421 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpgrc" event={"ID":"efe6a4fa-c797-48ac-bf89-c201f50c6a82","Type":"ContainerStarted","Data":"dfe94c40e20f2d600edf66b958c7f612de1c3c2cf7017cf3f9e3dac2034f3b2f"} Aug 05 12:19:18.249722 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.249704 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hftm8" event={"ID":"6970973f-db5b-4900-8ffa-632c76887ba3","Type":"ContainerStarted","Data":"1ad3e7e5768f4017f2d6c7d46acbf24b3910ac0382b01eaf72a11cc5e9980cbe"} Aug 05 12:19:18.250984 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.250967 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4kmm4" event={"ID":"d2112b6a-081c-4700-8789-2e82809fdbba","Type":"ContainerStarted","Data":"99fc70acbb3edec4da1fa6b080e26779db91fbdd9852f1fd8fe5a00eaef1ed5c"} Aug 05 12:19:18.271259 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.270130 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4kmm4" podStartSLOduration=2.193509929 podStartE2EDuration="21.27011456s" totalImagesPullingTime="19.076604631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:18.269740599 +0000 UTC m=+21.780411667" watchObservedRunningTime="2026-08-05 12:19:18.27011456 +0000 UTC m=+21.780785631" Aug 05 12:19:18.283600 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.283345 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-npm29" podStartSLOduration=10.079263258 podStartE2EDuration="21.283327907s" totalImagesPullingTime="11.204064649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:18.282736653 +0000 UTC m=+21.793407721" watchObservedRunningTime="2026-08-05 12:19:18.283327907 +0000 UTC m=+21.793998977" Aug 05 12:19:18.295430 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.295398 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-192.ec2.internal" podStartSLOduration=21.295388364 podStartE2EDuration="21.295388364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:18.295209968 +0000 UTC m=+21.805881037" watchObservedRunningTime="2026-08-05 12:19:18.295388364 +0000 UTC m=+21.806059432" Aug 05 12:19:18.324733 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.324698 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hftm8" podStartSLOduration=2.252686737 podStartE2EDuration="21.324686032s" totalImagesPullingTime="19.071999295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:18.324655534 +0000 UTC m=+21.835326602" watchObservedRunningTime="2026-08-05 12:19:18.324686032 +0000 UTC m=+21.835357096" Aug 05 12:19:18.342054 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.342002 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qpgrc" podStartSLOduration=2.029259935 podStartE2EDuration="21.341985339s" totalImagesPullingTime="19.312725404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:18.340944333 +0000 UTC m=+21.851615402" watchObservedRunningTime="2026-08-05 12:19:18.341985339 +0000 UTC m=+21.852656408" Aug 05 12:19:18.355038 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:18.354980 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-glb5w" podStartSLOduration=2.472283138 podStartE2EDuration="21.354966317s" totalImagesPullingTime="18.882683179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:18.354637707 +0000 UTC m=+21.865308777" watchObservedRunningTime="2026-08-05 12:19:18.354966317 +0000 UTC m=+21.865637384" Aug 05 12:19:19.029706 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.029666 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:19.029890 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:19.029797 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:19.160044 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.159995 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:19:19.160829 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.160806 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:19:19.256149 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.255950 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" event={"ID":"085be5e42d0150ff2c7d62ba258a4275","Type":"ContainerStarted","Data":"2bfadbd1bf818e37c8cbc107ca1060a72988375226ca91728d07c3ad3a4c9c47"} Aug 05 12:19:19.257718 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.257690 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fvs7p" event={"ID":"86160c72-c49f-4eb5-9484-6f764aeae43b","Type":"ContainerStarted","Data":"6364fbe95372cb468376edf219202ec9404c378e3b8fd770188e1e1b2305fcc4"} Aug 05 12:19:19.258555 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.258528 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:19:19.258989 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.258969 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4kmm4" Aug 05 12:19:19.271226 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.271183 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-192.ec2.internal" podStartSLOduration=22.271168741 podStartE2EDuration="22.271168741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:19.270404255 +0000 UTC m=+22.781075324" watchObservedRunningTime="2026-08-05 12:19:19.271168741 +0000 UTC m=+22.781839810" Aug 05 12:19:19.297588 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.297511 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fvs7p" podStartSLOduration=3.270705421 podStartE2EDuration="22.297499592s" totalImagesPullingTime="19.026794171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:19.297317192 +0000 UTC m=+22.807988255" watchObservedRunningTime="2026-08-05 12:19:19.297499592 +0000 UTC m=+22.808170660" Aug 05 12:19:19.580054 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.580032 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 05 12:19:19.931668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.931497 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T12:19:19.580052857Z","UUID":"9024f051-7172-4b72-8b2a-958a26d207fa","Handler":null,"Name":"","Endpoint":""} Aug 05 12:19:19.933191 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.933151 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 05 12:19:19.933191 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:19.933197 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 05 12:19:20.029471 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:20.029437 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:20.029650 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:20.029565 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:20.029650 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:20.029624 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:20.029790 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:20.029762 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:20.261831 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:20.261757 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" event={"ID":"39b10769-8554-4e57-974f-b625bfa322cf","Type":"ContainerStarted","Data":"9e4cae78db4c940d7b2bc349dcc0cd38d30409794eb64a6623842e9529aea8d4"} Aug 05 12:19:20.265434 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:20.265414 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:19:20.265790 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:20.265768 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"08076c40d17dc0b07db84150f45316f5d3d4f7972ecc6d9ef351479c9a90393c"} Aug 05 12:19:21.029850 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:21.029814 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:21.030107 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:21.029938 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:22.029238 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:22.029207 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:22.029723 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:22.029211 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:22.029723 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:22.029338 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:22.029723 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:22.029419 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:23.029541 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.029357 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:23.030181 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:23.029624 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:23.273566 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.273533 2560 generic.go:356] "Generic (PLEG): container finished" podID="35449318-618e-4493-a22f-388310f5cbae" containerID="56f3288e6d99945b9570cfe81299007e2b0a51f51b3851149854f16e7d3eb726" exitCode=0 Aug 05 12:19:23.273749 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.273608 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" event={"ID":"35449318-618e-4493-a22f-388310f5cbae","Type":"ContainerDied","Data":"56f3288e6d99945b9570cfe81299007e2b0a51f51b3851149854f16e7d3eb726"} Aug 05 12:19:23.275655 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.275624 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" event={"ID":"39b10769-8554-4e57-974f-b625bfa322cf","Type":"ContainerStarted","Data":"791aa014b97b6a49e38973aa358263142d1bad2b3cac2c562f332c4a4f563400"} Aug 05 12:19:23.279175 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.279157 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:19:23.279838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.279785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"5e70dc575a3b0285fc18967b04e0f157b0a04950ee373c9a09908e877efb3528"} Aug 05 12:19:23.280022 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.280008 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:19:23.280095 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.280060 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:19:23.280169 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.280146 2560 scope.go:117] "RemoveContainer" containerID="d814a9113d8575160a947b2cb210ce12cd958dcb0c748dfadf5d994638e14a17" Aug 05 12:19:23.296208 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.296092 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:19:23.297492 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.297474 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:19:23.342933 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:23.341819 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j9l52" podStartSLOduration=3.325280549 podStartE2EDuration="26.341799478s" totalImagesPullingTime="23.016518929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:23.340718937 +0000 UTC m=+26.851390003" watchObservedRunningTime="2026-08-05 12:19:23.341799478 +0000 UTC m=+26.852470551" Aug 05 12:19:24.029701 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.029666 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:24.029701 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.029691 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:24.030477 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:24.029796 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:24.030477 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:24.029910 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:24.284987 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.284756 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:19:24.285266 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.285243 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" event={"ID":"d4c83e3a-d7c3-4e67-b81e-bc7af7235da4","Type":"ContainerStarted","Data":"f1bb7e1b841286b541ff4a81fa3054350a3c58e5785b74ae2eb8dd6689b4dc92"} Aug 05 12:19:24.285360 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.285328 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 05 12:19:24.315443 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.315393 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" podStartSLOduration=8.269652765 podStartE2EDuration="27.315373037s" totalImagesPullingTime="19.045720272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:24.314223987 +0000 UTC m=+27.824895055" watchObservedRunningTime="2026-08-05 12:19:24.315373037 +0000 UTC m=+27.826044107" Aug 05 12:19:24.583875 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.583789 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wcxrc"] Aug 05 12:19:24.584011 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.583900 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:24.584011 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:24.583994 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:24.586923 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.586885 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6m4tz"] Aug 05 12:19:24.587075 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.586986 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:24.587149 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:24.587082 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:24.587498 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.587476 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kqsfn"] Aug 05 12:19:24.587591 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:24.587572 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:24.587673 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:24.587651 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:25.289678 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:25.289599 2560 generic.go:356] "Generic (PLEG): container finished" podID="35449318-618e-4493-a22f-388310f5cbae" containerID="71c41862ad2ce0d7def06c32ac64a94c1b0dfdd25d7aaee81123ed873cb8929e" exitCode=0 Aug 05 12:19:25.290071 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:25.289677 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" event={"ID":"35449318-618e-4493-a22f-388310f5cbae","Type":"ContainerDied","Data":"71c41862ad2ce0d7def06c32ac64a94c1b0dfdd25d7aaee81123ed873cb8929e"} Aug 05 12:19:25.290071 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:25.289838 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 05 12:19:26.029592 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:26.029554 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:26.029770 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:26.029661 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:26.029770 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:26.029716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:26.029863 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:26.029813 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:27.030597 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:27.030566 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:27.030950 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:27.030655 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:27.150720 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:27.150684 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:19:27.150917 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:27.150900 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Aug 05 12:19:27.165518 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:27.165480 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" podUID="d4c83e3a-d7c3-4e67-b81e-bc7af7235da4" containerName="ovnkube-controller" probeResult="failure" output="" Aug 05 12:19:27.175410 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:27.175378 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" podUID="d4c83e3a-d7c3-4e67-b81e-bc7af7235da4" containerName="ovnkube-controller" probeResult="failure" output="" Aug 05 12:19:27.297004 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:27.296932 2560 generic.go:356] "Generic (PLEG): container finished" podID="35449318-618e-4493-a22f-388310f5cbae" containerID="c82b6dfd74e2da7519ccd3005230642acd720b7c324978b9dccea81dc08aa47b" exitCode=0 Aug 05 12:19:27.297004 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:27.296987 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" event={"ID":"35449318-618e-4493-a22f-388310f5cbae","Type":"ContainerDied","Data":"c82b6dfd74e2da7519ccd3005230642acd720b7c324978b9dccea81dc08aa47b"} Aug 05 12:19:28.029623 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:28.029591 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:28.029776 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:28.029711 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:28.029776 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:28.029762 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:28.029901 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:28.029871 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:29.029418 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:29.029193 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:29.029807 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.029532 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:29.614826 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:29.614793 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:29.614826 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:29.614830 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:29.615061 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.614967 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 12:19:29.615061 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.614973 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:19:29.615061 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.615057 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs podName:dfd0ac47-bc49-46f0-8848-b17a54c9df3a nodeName:}" failed. No retries permitted until 2026-08-05 12:20:01.615034279 +0000 UTC m=+65.125705329 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs") pod "network-metrics-daemon-wcxrc" (UID: "dfd0ac47-bc49-46f0-8848-b17a54c9df3a") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 12:19:29.615194 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.615077 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret podName:72a568d6-8cc6-4dd4-9c93-2c1393198783 nodeName:}" failed. No retries permitted until 2026-08-05 12:20:01.615067384 +0000 UTC m=+65.125738436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret") pod "global-pull-secret-syncer-kqsfn" (UID: "72a568d6-8cc6-4dd4-9c93-2c1393198783") : object "kube-system"/"original-pull-secret" not registered Aug 05 12:19:29.715551 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:29.715517 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:29.715721 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.715700 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 12:19:29.715783 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.715729 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 12:19:29.715783 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.715743 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9bbx7 for pod openshift-network-diagnostics/network-check-target-6m4tz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:19:29.715888 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:29.715804 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7 podName:636d0bb5-96fa-410a-b1c1-c613d11e9a29 nodeName:}" failed. No retries permitted until 2026-08-05 12:20:01.715783791 +0000 UTC m=+65.226454854 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bbx7" (UniqueName: "kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7") pod "network-check-target-6m4tz" (UID: "636d0bb5-96fa-410a-b1c1-c613d11e9a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 12:19:30.029123 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:30.029053 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:30.029123 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:30.029089 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:30.029350 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:30.029168 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6m4tz" podUID="636d0bb5-96fa-410a-b1c1-c613d11e9a29" Aug 05 12:19:30.029350 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:30.029293 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcxrc" podUID="dfd0ac47-bc49-46f0-8848-b17a54c9df3a" Aug 05 12:19:31.030093 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.030046 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:31.030561 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:31.030192 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kqsfn" podUID="72a568d6-8cc6-4dd4-9c93-2c1393198783" Aug 05 12:19:31.360939 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.360863 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-192.ec2.internal" event="NodeReady" Aug 05 12:19:31.361111 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.360994 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 05 12:19:31.411881 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.411842 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s27hp"] Aug 05 12:19:31.414635 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.414613 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76c8cdc7bf-fz5rw"] Aug 05 12:19:31.414766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.414732 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.416460 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.416440 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jpnjw"] Aug 05 12:19:31.416580 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.416549 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.418335 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.418223 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jpnjw" Aug 05 12:19:31.418458 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.418435 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4c62j\"" Aug 05 12:19:31.418607 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.418558 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 05 12:19:31.419719 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.419129 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 05 12:19:31.419719 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.419287 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 05 12:19:31.419719 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.419493 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vkpqd\"" Aug 05 12:19:31.419719 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.419508 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 05 12:19:31.421340 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.421315 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 05 12:19:31.422190 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.422166 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 05 12:19:31.422738 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.422722 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 05 12:19:31.423656 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.423630 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-swj9c\"" Aug 05 12:19:31.423762 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.423704 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 05 12:19:31.428020 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.427950 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 05 12:19:31.428374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.428352 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jpnjw"] Aug 05 12:19:31.429670 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.429646 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s27hp"] Aug 05 12:19:31.431972 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.431945 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c8cdc7bf-fz5rw"] Aug 05 12:19:31.528020 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.527981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-bound-sa-token\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.528020 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6js5\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-kube-api-access-h6js5\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.528229 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjwqq\" (UniqueName: \"kubernetes.io/projected/dbe02a6d-47a2-419f-bc5f-803a6a8ce98e-kube-api-access-bjwqq\") pod \"ingress-canary-jpnjw\" (UID: \"dbe02a6d-47a2-419f-bc5f-803a6a8ce98e\") " pod="openshift-ingress-canary/ingress-canary-jpnjw" Aug 05 12:19:31.528229 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528077 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-certificates\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.528229 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528112 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.528229 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528172 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-trusted-ca\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.528411 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtl5d\" (UniqueName: \"kubernetes.io/projected/aa9b57fb-914f-4754-9167-137c1d12b79c-kube-api-access-qtl5d\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.528411 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-installation-pull-secrets\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.528411 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528382 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.528555 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe02a6d-47a2-419f-bc5f-803a6a8ce98e-cert\") pod \"ingress-canary-jpnjw\" (UID: \"dbe02a6d-47a2-419f-bc5f-803a6a8ce98e\") " pod="openshift-ingress-canary/ingress-canary-jpnjw" Aug 05 12:19:31.528555 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528469 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-image-registry-private-configuration\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.528555 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528532 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa9b57fb-914f-4754-9167-137c1d12b79c-config-volume\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.528696 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-ca-trust-extracted\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.528696 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.528605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa9b57fb-914f-4754-9167-137c1d12b79c-tmp-dir\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.629900 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.629818 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-trusted-ca\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630055 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630022 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtl5d\" (UniqueName: \"kubernetes.io/projected/aa9b57fb-914f-4754-9167-137c1d12b79c-kube-api-access-qtl5d\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.630111 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-installation-pull-secrets\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630111 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630209 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe02a6d-47a2-419f-bc5f-803a6a8ce98e-cert\") pod \"ingress-canary-jpnjw\" (UID: \"dbe02a6d-47a2-419f-bc5f-803a6a8ce98e\") " pod="openshift-ingress-canary/ingress-canary-jpnjw" Aug 05 12:19:31.630209 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-image-registry-private-configuration\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630209 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630169 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa9b57fb-914f-4754-9167-137c1d12b79c-config-volume\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.630209 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630184 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-ca-trust-extracted\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630209 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630203 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa9b57fb-914f-4754-9167-137c1d12b79c-tmp-dir\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.630449 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630228 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-bound-sa-token\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630449 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630255 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6js5\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-kube-api-access-h6js5\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630449 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjwqq\" (UniqueName: \"kubernetes.io/projected/dbe02a6d-47a2-419f-bc5f-803a6a8ce98e-kube-api-access-bjwqq\") pod \"ingress-canary-jpnjw\" (UID: \"dbe02a6d-47a2-419f-bc5f-803a6a8ce98e\") " pod="openshift-ingress-canary/ingress-canary-jpnjw" Aug 05 12:19:31.630449 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630320 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-certificates\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630449 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630334 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.630449 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:31.630431 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 12:19:31.630738 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:31.630493 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls podName:aa9b57fb-914f-4754-9167-137c1d12b79c nodeName:}" failed. No retries permitted until 2026-08-05 12:19:32.130474654 +0000 UTC m=+35.641145700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls") pod "dns-default-s27hp" (UID: "aa9b57fb-914f-4754-9167-137c1d12b79c") : secret "dns-default-metrics-tls" not found Aug 05 12:19:31.630738 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630722 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-ca-trust-extracted\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.630903 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630876 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-trusted-ca\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.631040 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:31.630969 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 12:19:31.631040 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.630979 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa9b57fb-914f-4754-9167-137c1d12b79c-tmp-dir\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.631040 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:31.630987 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c8cdc7bf-fz5rw: secret "image-registry-tls" not found Aug 05 12:19:31.631202 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:31.631051 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls podName:1e2f5221-f826-4d9b-8b9e-61c7db3ffce0 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:32.131033749 +0000 UTC m=+35.641704796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls") pod "image-registry-76c8cdc7bf-fz5rw" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0") : secret "image-registry-tls" not found Aug 05 12:19:31.631513 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.631492 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-certificates\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.631670 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.631648 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aa9b57fb-914f-4754-9167-137c1d12b79c-config-volume\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.635426 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.635408 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dbe02a6d-47a2-419f-bc5f-803a6a8ce98e-cert\") pod \"ingress-canary-jpnjw\" (UID: \"dbe02a6d-47a2-419f-bc5f-803a6a8ce98e\") " pod="openshift-ingress-canary/ingress-canary-jpnjw" Aug 05 12:19:31.635426 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.635413 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-image-registry-private-configuration\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.635579 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.635413 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-installation-pull-secrets\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.639498 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.639477 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtl5d\" (UniqueName: \"kubernetes.io/projected/aa9b57fb-914f-4754-9167-137c1d12b79c-kube-api-access-qtl5d\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:31.642140 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.642115 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6js5\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-kube-api-access-h6js5\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.642791 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.642769 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjwqq\" (UniqueName: \"kubernetes.io/projected/dbe02a6d-47a2-419f-bc5f-803a6a8ce98e-kube-api-access-bjwqq\") pod \"ingress-canary-jpnjw\" (UID: \"dbe02a6d-47a2-419f-bc5f-803a6a8ce98e\") " pod="openshift-ingress-canary/ingress-canary-jpnjw" Aug 05 12:19:31.643148 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.643126 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-bound-sa-token\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:31.744466 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.744433 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jpnjw" Aug 05 12:19:31.889238 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:31.889021 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jpnjw"] Aug 05 12:19:31.893463 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:19:31.893440 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe02a6d_47a2_419f_bc5f_803a6a8ce98e.slice/crio-ae0f7fb15785a1544b690def984ae0b3555c2e7968f3c90f771929c8646eecfd WatchSource:0}: Error finding container ae0f7fb15785a1544b690def984ae0b3555c2e7968f3c90f771929c8646eecfd: Status 404 returned error can't find the container with id ae0f7fb15785a1544b690def984ae0b3555c2e7968f3c90f771929c8646eecfd Aug 05 12:19:32.029069 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.029026 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:19:32.029316 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.029275 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:19:32.031525 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.031500 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 12:19:32.032317 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.031500 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 12:19:32.032317 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.031549 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rdzzt\"" Aug 05 12:19:32.032317 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.031769 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 12:19:32.032317 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.031974 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zm7jq\"" Aug 05 12:19:32.134601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.134566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:32.134765 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.134613 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:32.134765 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:32.134703 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 12:19:32.134765 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:32.134719 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c8cdc7bf-fz5rw: secret "image-registry-tls" not found Aug 05 12:19:32.134876 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:32.134765 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 12:19:32.134876 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:32.134783 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls podName:1e2f5221-f826-4d9b-8b9e-61c7db3ffce0 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:33.134767877 +0000 UTC m=+36.645438922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls") pod "image-registry-76c8cdc7bf-fz5rw" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0") : secret "image-registry-tls" not found Aug 05 12:19:32.134876 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:32.134813 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls podName:aa9b57fb-914f-4754-9167-137c1d12b79c nodeName:}" failed. No retries permitted until 2026-08-05 12:19:33.134799045 +0000 UTC m=+36.645470091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls") pod "dns-default-s27hp" (UID: "aa9b57fb-914f-4754-9167-137c1d12b79c") : secret "dns-default-metrics-tls" not found Aug 05 12:19:32.312406 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.312326 2560 generic.go:356] "Generic (PLEG): container finished" podID="35449318-618e-4493-a22f-388310f5cbae" containerID="08e51b28724df066082efb8cd6dfbb3a51807d8624755bd283d5fae153fed62b" exitCode=0 Aug 05 12:19:32.312406 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.312393 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" event={"ID":"35449318-618e-4493-a22f-388310f5cbae","Type":"ContainerDied","Data":"08e51b28724df066082efb8cd6dfbb3a51807d8624755bd283d5fae153fed62b"} Aug 05 12:19:32.313481 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:32.313453 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jpnjw" event={"ID":"dbe02a6d-47a2-419f-bc5f-803a6a8ce98e","Type":"ContainerStarted","Data":"ae0f7fb15785a1544b690def984ae0b3555c2e7968f3c90f771929c8646eecfd"} Aug 05 12:19:33.029719 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:33.029675 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:19:33.032466 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:33.032446 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 12:19:33.142417 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:33.142380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:33.142610 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:33.142455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:33.142610 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:33.142560 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 12:19:33.142610 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:33.142580 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c8cdc7bf-fz5rw: secret "image-registry-tls" not found Aug 05 12:19:33.142818 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:33.142631 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 12:19:33.142818 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:33.142657 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls podName:1e2f5221-f826-4d9b-8b9e-61c7db3ffce0 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:35.142636844 +0000 UTC m=+38.653307891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls") pod "image-registry-76c8cdc7bf-fz5rw" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0") : secret "image-registry-tls" not found Aug 05 12:19:33.142818 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:33.142690 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls podName:aa9b57fb-914f-4754-9167-137c1d12b79c nodeName:}" failed. No retries permitted until 2026-08-05 12:19:35.142672757 +0000 UTC m=+38.653343820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls") pod "dns-default-s27hp" (UID: "aa9b57fb-914f-4754-9167-137c1d12b79c") : secret "dns-default-metrics-tls" not found Aug 05 12:19:33.319432 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:33.319353 2560 generic.go:356] "Generic (PLEG): container finished" podID="35449318-618e-4493-a22f-388310f5cbae" containerID="915f76265ca36c066eb8e8ec54f6184e30d4db97e003ee08b78fe35ccaa09e87" exitCode=0 Aug 05 12:19:33.319603 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:33.319429 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" event={"ID":"35449318-618e-4493-a22f-388310f5cbae","Type":"ContainerDied","Data":"915f76265ca36c066eb8e8ec54f6184e30d4db97e003ee08b78fe35ccaa09e87"} Aug 05 12:19:34.325159 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:34.325090 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" event={"ID":"35449318-618e-4493-a22f-388310f5cbae","Type":"ContainerStarted","Data":"c711ba8bb5fd7e9a1add3e40df80151cefdc3f3576479d47e94f882d45381f6d"} Aug 05 12:19:34.349341 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:34.349287 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2xcvz" podStartSLOduration=7.369722629 podStartE2EDuration="37.349272724s" totalImagesPullingTime="29.979550095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:34.348560263 +0000 UTC m=+37.859231353" watchObservedRunningTime="2026-08-05 12:19:34.349272724 +0000 UTC m=+37.859943791" Aug 05 12:19:35.157985 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:35.157896 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:35.158142 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:35.158041 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 12:19:35.158142 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:35.158062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:35.158142 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:35.158107 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls podName:aa9b57fb-914f-4754-9167-137c1d12b79c nodeName:}" failed. No retries permitted until 2026-08-05 12:19:39.158091054 +0000 UTC m=+42.668762104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls") pod "dns-default-s27hp" (UID: "aa9b57fb-914f-4754-9167-137c1d12b79c") : secret "dns-default-metrics-tls" not found Aug 05 12:19:35.158245 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:35.158152 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 12:19:35.158245 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:35.158162 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c8cdc7bf-fz5rw: secret "image-registry-tls" not found Aug 05 12:19:35.158245 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:35.158202 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls podName:1e2f5221-f826-4d9b-8b9e-61c7db3ffce0 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:39.158191522 +0000 UTC m=+42.668862569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls") pod "image-registry-76c8cdc7bf-fz5rw" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0") : secret "image-registry-tls" not found Aug 05 12:19:35.329312 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:35.329275 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jpnjw" event={"ID":"dbe02a6d-47a2-419f-bc5f-803a6a8ce98e","Type":"ContainerStarted","Data":"2e7e8b06b6ef5700397ba594ac1dc029a6c63332dd9e435dd2b033b002bd1b5b"} Aug 05 12:19:35.346899 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:35.346852 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jpnjw" podStartSLOduration=1.494202839 podStartE2EDuration="4.346837938s" totalImagesPullingTime="2.852635099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:35.346647592 +0000 UTC m=+38.857318660" watchObservedRunningTime="2026-08-05 12:19:35.346837938 +0000 UTC m=+38.857509045" Aug 05 12:19:39.187210 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:39.187166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:39.187627 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:39.187331 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:39.187627 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:39.187347 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 12:19:39.187627 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:39.187406 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls podName:aa9b57fb-914f-4754-9167-137c1d12b79c nodeName:}" failed. No retries permitted until 2026-08-05 12:19:47.187391257 +0000 UTC m=+50.698062303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls") pod "dns-default-s27hp" (UID: "aa9b57fb-914f-4754-9167-137c1d12b79c") : secret "dns-default-metrics-tls" not found Aug 05 12:19:39.187627 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:39.187431 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 12:19:39.187627 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:39.187443 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c8cdc7bf-fz5rw: secret "image-registry-tls" not found Aug 05 12:19:39.187627 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:39.187485 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls podName:1e2f5221-f826-4d9b-8b9e-61c7db3ffce0 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:47.187473816 +0000 UTC m=+50.698144861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls") pod "image-registry-76c8cdc7bf-fz5rw" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0") : secret "image-registry-tls" not found Aug 05 12:19:41.727440 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.727406 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-blm6p"] Aug 05 12:19:41.768984 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.768956 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-blm6p"] Aug 05 12:19:41.769118 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.769058 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:41.773105 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.773083 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 05 12:19:41.773431 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.773413 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f4rtr\"" Aug 05 12:19:41.773504 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.773485 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 05 12:19:41.774146 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.774126 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 05 12:19:41.774223 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.774130 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 05 12:19:41.907363 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.907332 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:41.907554 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.907377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:41.907554 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.907399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-crio-socket\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:41.907554 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.907456 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-data-volume\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:41.907554 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:41.907497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-555bv\" (UniqueName: \"kubernetes.io/projected/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-api-access-555bv\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.008551 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.008474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.008551 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.008521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.008551 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.008551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-crio-socket\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.008815 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.008575 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-data-volume\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.008815 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.008599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-555bv\" (UniqueName: \"kubernetes.io/projected/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-api-access-555bv\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.008815 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:42.008631 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 12:19:42.008815 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:42.008636 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 12:19:42.008815 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.008718 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-crio-socket\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.008815 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:42.008713 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:42.508692271 +0000 UTC m=+46.019363331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : configmap "kube-rbac-proxy" not found Aug 05 12:19:42.008815 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:42.008792 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:42.508776351 +0000 UTC m=+46.019447397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : secret "insights-runtime-extractor-tls" not found Aug 05 12:19:42.009046 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.008927 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-data-volume\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.018557 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.018535 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-555bv\" (UniqueName: \"kubernetes.io/projected/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-api-access-555bv\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.511988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.511950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.512160 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:42.512000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:42.512160 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:42.512075 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 12:19:42.512160 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:42.512099 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 12:19:42.512160 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:42.512137 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:43.512123432 +0000 UTC m=+47.022794479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : configmap "kube-rbac-proxy" not found Aug 05 12:19:42.512160 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:42.512158 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:43.512143781 +0000 UTC m=+47.022814828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : secret "insights-runtime-extractor-tls" not found Aug 05 12:19:43.067678 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.067641 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-z86cb"] Aug 05 12:19:43.090559 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.090527 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-z86cb"] Aug 05 12:19:43.090748 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.090654 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.094100 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.094081 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Aug 05 12:19:43.094399 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.094382 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Aug 05 12:19:43.094484 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.094445 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Aug 05 12:19:43.094812 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.094796 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sbf45\"" Aug 05 12:19:43.095114 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.095099 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Aug 05 12:19:43.218069 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.218033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5286\" (UniqueName: \"kubernetes.io/projected/e637b73a-3d7d-493d-a76b-5a683c1c1a78-kube-api-access-w5286\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.218263 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.218086 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e637b73a-3d7d-493d-a76b-5a683c1c1a78-signing-key\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.218263 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.218102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e637b73a-3d7d-493d-a76b-5a683c1c1a78-signing-cabundle\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.319094 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.319016 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5286\" (UniqueName: \"kubernetes.io/projected/e637b73a-3d7d-493d-a76b-5a683c1c1a78-kube-api-access-w5286\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.319094 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.319066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e637b73a-3d7d-493d-a76b-5a683c1c1a78-signing-key\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.319094 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.319092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e637b73a-3d7d-493d-a76b-5a683c1c1a78-signing-cabundle\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.319820 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.319796 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e637b73a-3d7d-493d-a76b-5a683c1c1a78-signing-cabundle\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.321263 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.321243 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e637b73a-3d7d-493d-a76b-5a683c1c1a78-signing-key\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.327800 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.327781 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5286\" (UniqueName: \"kubernetes.io/projected/e637b73a-3d7d-493d-a76b-5a683c1c1a78-kube-api-access-w5286\") pod \"service-ca-98c88fbb5-z86cb\" (UID: \"e637b73a-3d7d-493d-a76b-5a683c1c1a78\") " pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.400004 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.399971 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" Aug 05 12:19:43.520800 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.520771 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:43.520940 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.520817 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:43.520940 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:43.520897 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 12:19:43.520940 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:43.520913 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 12:19:43.521050 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:43.520957 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:45.520942691 +0000 UTC m=+49.031613738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : configmap "kube-rbac-proxy" not found Aug 05 12:19:43.521050 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:43.520970 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:45.520964245 +0000 UTC m=+49.031635291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : secret "insights-runtime-extractor-tls" not found Aug 05 12:19:43.536189 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:43.536163 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-z86cb"] Aug 05 12:19:43.549208 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:19:43.549179 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode637b73a_3d7d_493d_a76b_5a683c1c1a78.slice/crio-c9a89efc484bb65154a65beb9b7d7d2699aeeab21c1d30fcd515e60ee30e4361 WatchSource:0}: Error finding container c9a89efc484bb65154a65beb9b7d7d2699aeeab21c1d30fcd515e60ee30e4361: Status 404 returned error can't find the container with id c9a89efc484bb65154a65beb9b7d7d2699aeeab21c1d30fcd515e60ee30e4361 Aug 05 12:19:44.346018 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:44.345992 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-glb5w_0474997c-86af-453b-8957-5e3360208078/dns-node-resolver/0.log" Aug 05 12:19:44.351353 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:44.351326 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" event={"ID":"e637b73a-3d7d-493d-a76b-5a683c1c1a78","Type":"ContainerStarted","Data":"c9a89efc484bb65154a65beb9b7d7d2699aeeab21c1d30fcd515e60ee30e4361"} Aug 05 12:19:45.342162 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:45.342135 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-npm29_d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4/node-ca/0.log" Aug 05 12:19:45.537514 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:45.537474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:45.537989 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:45.537549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:45.537989 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:45.537653 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 12:19:45.537989 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:45.537659 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 12:19:45.537989 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:45.537720 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:49.537699152 +0000 UTC m=+53.048370223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : configmap "kube-rbac-proxy" not found Aug 05 12:19:45.537989 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:45.537747 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:49.537728406 +0000 UTC m=+53.048399457 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : secret "insights-runtime-extractor-tls" not found Aug 05 12:19:46.343550 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:46.343475 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jpnjw_dbe02a6d-47a2-419f-bc5f-803a6a8ce98e/serve-healthcheck-canary/0.log" Aug 05 12:19:46.357682 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:46.357656 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" event={"ID":"e637b73a-3d7d-493d-a76b-5a683c1c1a78","Type":"ContainerStarted","Data":"38bc3e362524f54bbbce51646318245008323950f527f5bc280803e649f9baf4"} Aug 05 12:19:46.376933 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:46.376883 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-z86cb" podStartSLOduration=0.933996026 podStartE2EDuration="3.376869537s" totalImagesPullingTime="2.442873511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:19:46.375498219 +0000 UTC m=+49.886169286" watchObservedRunningTime="2026-08-05 12:19:46.376869537 +0000 UTC m=+49.887540656" Aug 05 12:19:47.250995 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:47.250959 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:19:47.251398 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:47.251045 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:19:47.251398 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:47.251123 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 12:19:47.251398 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:47.251142 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 12:19:47.251398 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:47.251152 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76c8cdc7bf-fz5rw: secret "image-registry-tls" not found Aug 05 12:19:47.251398 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:47.251194 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls podName:aa9b57fb-914f-4754-9167-137c1d12b79c nodeName:}" failed. No retries permitted until 2026-08-05 12:20:03.251174244 +0000 UTC m=+66.761845290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls") pod "dns-default-s27hp" (UID: "aa9b57fb-914f-4754-9167-137c1d12b79c") : secret "dns-default-metrics-tls" not found Aug 05 12:19:47.251398 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:47.251214 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls podName:1e2f5221-f826-4d9b-8b9e-61c7db3ffce0 nodeName:}" failed. No retries permitted until 2026-08-05 12:20:03.251205942 +0000 UTC m=+66.761876988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls") pod "image-registry-76c8cdc7bf-fz5rw" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0") : secret "image-registry-tls" not found Aug 05 12:19:49.571115 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:49.571076 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:49.571604 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:49.571125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:49.571604 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:49.571257 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 12:19:49.571604 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:19:49.571369 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls podName:dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3 nodeName:}" failed. No retries permitted until 2026-08-05 12:19:57.571346953 +0000 UTC m=+61.082018003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-blm6p" (UID: "dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3") : secret "insights-runtime-extractor-tls" not found Aug 05 12:19:49.571604 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:49.571591 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:57.174878 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:57.174841 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q8nkk" Aug 05 12:19:57.633647 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:57.633566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:57.635813 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:57.635782 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-blm6p\" (UID: \"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3\") " pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:57.680552 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:57.680524 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f4rtr\"" Aug 05 12:19:57.688378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:57.688354 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-blm6p" Aug 05 12:19:57.819945 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:57.819917 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-blm6p"] Aug 05 12:19:57.822347 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:19:57.822292 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc36b7af_e928_464e_8cbc_e7bf3b3ee2b3.slice/crio-91f4567609a6f23a82e8cd6ecdbd29879d265ccc7ff0fcd705e676f3edc3db02 WatchSource:0}: Error finding container 91f4567609a6f23a82e8cd6ecdbd29879d265ccc7ff0fcd705e676f3edc3db02: Status 404 returned error can't find the container with id 91f4567609a6f23a82e8cd6ecdbd29879d265ccc7ff0fcd705e676f3edc3db02 Aug 05 12:19:58.387599 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:58.387568 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-blm6p" event={"ID":"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3","Type":"ContainerStarted","Data":"ad0ffbba7fdffc55fedeed19b3b4079f25ea35a6e01a83f16fe9a355beaea07b"} Aug 05 12:19:58.387956 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:58.387622 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-blm6p" event={"ID":"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3","Type":"ContainerStarted","Data":"91f4567609a6f23a82e8cd6ecdbd29879d265ccc7ff0fcd705e676f3edc3db02"} Aug 05 12:19:59.391749 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:19:59.391709 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-blm6p" event={"ID":"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3","Type":"ContainerStarted","Data":"db7ed91ed5c29f01717ee2efee90259bbff27506fdae9673966fc3c8b6f255a3"} Aug 05 12:20:00.396547 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:00.396516 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-blm6p" event={"ID":"dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3","Type":"ContainerStarted","Data":"b36a4164cf54045be2f8e0a4fde7b855d00a8f23a6f9c887dc13b4c898750dab"} Aug 05 12:20:00.415935 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:00.415892 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-blm6p" podStartSLOduration=17.092654739 podStartE2EDuration="19.415878258s" totalImagesPullingTime="2.323223519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:19:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:00.414814728 +0000 UTC m=+63.925485797" watchObservedRunningTime="2026-08-05 12:20:00.415878258 +0000 UTC m=+63.926549304" Aug 05 12:20:01.668686 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.668648 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:20:01.668686 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.668681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:20:01.671379 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.671362 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 12:20:01.672226 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.672210 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 12:20:01.681235 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.681209 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dfd0ac47-bc49-46f0-8848-b17a54c9df3a-metrics-certs\") pod \"network-metrics-daemon-wcxrc\" (UID: \"dfd0ac47-bc49-46f0-8848-b17a54c9df3a\") " pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:20:01.681351 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.681325 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72a568d6-8cc6-4dd4-9c93-2c1393198783-original-pull-secret\") pod \"global-pull-secret-syncer-kqsfn\" (UID: \"72a568d6-8cc6-4dd4-9c93-2c1393198783\") " pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:20:01.746188 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.746159 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zm7jq\"" Aug 05 12:20:01.754101 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.754082 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcxrc" Aug 05 12:20:01.769263 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.769241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:20:01.771999 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.771977 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 12:20:01.782617 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.782595 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 12:20:01.792782 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.792756 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bbx7\" (UniqueName: \"kubernetes.io/projected/636d0bb5-96fa-410a-b1c1-c613d11e9a29-kube-api-access-9bbx7\") pod \"network-check-target-6m4tz\" (UID: \"636d0bb5-96fa-410a-b1c1-c613d11e9a29\") " pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:20:01.839651 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.839619 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kqsfn" Aug 05 12:20:01.876407 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.875654 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wcxrc"] Aug 05 12:20:01.879078 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:01.879053 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd0ac47_bc49_46f0_8848_b17a54c9df3a.slice/crio-ab0ba24b84853ca3b9f15c75e929ff08b03041b51baaa05a869734c7333ab3c2 WatchSource:0}: Error finding container ab0ba24b84853ca3b9f15c75e929ff08b03041b51baaa05a869734c7333ab3c2: Status 404 returned error can't find the container with id ab0ba24b84853ca3b9f15c75e929ff08b03041b51baaa05a869734c7333ab3c2 Aug 05 12:20:01.960929 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:01.960834 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kqsfn"] Aug 05 12:20:01.964682 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:01.964651 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a568d6_8cc6_4dd4_9c93_2c1393198783.slice/crio-98df3e9c8878d8058d749fce4b88e53b4eb37151e3ad31a8495b5de9ca0ec605 WatchSource:0}: Error finding container 98df3e9c8878d8058d749fce4b88e53b4eb37151e3ad31a8495b5de9ca0ec605: Status 404 returned error can't find the container with id 98df3e9c8878d8058d749fce4b88e53b4eb37151e3ad31a8495b5de9ca0ec605 Aug 05 12:20:02.042402 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.042377 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rdzzt\"" Aug 05 12:20:02.050390 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.050377 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:20:02.179252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.179095 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6m4tz"] Aug 05 12:20:02.181580 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:02.181554 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636d0bb5_96fa_410a_b1c1_c613d11e9a29.slice/crio-c3274a2f1d56790a2ef8e85f8cc42e2889dbdafbd44b792e672e6e2768c2b70a WatchSource:0}: Error finding container c3274a2f1d56790a2ef8e85f8cc42e2889dbdafbd44b792e672e6e2768c2b70a: Status 404 returned error can't find the container with id c3274a2f1d56790a2ef8e85f8cc42e2889dbdafbd44b792e672e6e2768c2b70a Aug 05 12:20:02.221149 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.221054 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc"] Aug 05 12:20:02.223500 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.223478 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.226755 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.226733 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Aug 05 12:20:02.231650 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.231623 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Aug 05 12:20:02.231891 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.231873 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Aug 05 12:20:02.232110 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.232095 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Aug 05 12:20:02.250324 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.250281 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76c8cdc7bf-fz5rw"] Aug 05 12:20:02.250555 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:02.250529 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" podUID="1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" Aug 05 12:20:02.250986 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.250970 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc"] Aug 05 12:20:02.273758 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.273723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnrmj\" (UniqueName: \"kubernetes.io/projected/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-kube-api-access-nnrmj\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.273758 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.273759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-tmp\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.273942 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.273776 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.331936 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.331898 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5749d664f8-6brsx"] Aug 05 12:20:02.333826 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.333811 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.374205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-bound-sa-token\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.374520 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-tmp\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.374520 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnrmj\" (UniqueName: \"kubernetes.io/projected/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-kube-api-access-nnrmj\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.374520 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374321 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hch7\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-kube-api-access-6hch7\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.374520 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374385 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.374520 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374416 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a2a686b-0758-4afc-a1b8-c2074bd13187-registry-certificates\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.374520 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374455 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a2a686b-0758-4afc-a1b8-c2074bd13187-trusted-ca\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.374949 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374531 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a2a686b-0758-4afc-a1b8-c2074bd13187-image-registry-private-configuration\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.374949 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a2a686b-0758-4afc-a1b8-c2074bd13187-installation-pull-secrets\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.374949 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-registry-tls\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.374949 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374659 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-tmp\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.374949 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.374663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a2a686b-0758-4afc-a1b8-c2074bd13187-ca-trust-extracted\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.375180 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.375122 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5749d664f8-6brsx"] Aug 05 12:20:02.376961 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.376940 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-klusterlet-config\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.388013 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.387992 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnrmj\" (UniqueName: \"kubernetes.io/projected/bdaa28b8-08d0-4d8d-9e80-14e0adecf684-kube-api-access-nnrmj\") pod \"klusterlet-addon-workmgr-5b99765cf-9p2gc\" (UID: \"bdaa28b8-08d0-4d8d-9e80-14e0adecf684\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.403756 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.403726 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcxrc" event={"ID":"dfd0ac47-bc49-46f0-8848-b17a54c9df3a","Type":"ContainerStarted","Data":"ab0ba24b84853ca3b9f15c75e929ff08b03041b51baaa05a869734c7333ab3c2"} Aug 05 12:20:02.404802 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.404773 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kqsfn" event={"ID":"72a568d6-8cc6-4dd4-9c93-2c1393198783","Type":"ContainerStarted","Data":"98df3e9c8878d8058d749fce4b88e53b4eb37151e3ad31a8495b5de9ca0ec605"} Aug 05 12:20:02.405784 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.405767 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:20:02.405866 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.405783 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6m4tz" event={"ID":"636d0bb5-96fa-410a-b1c1-c613d11e9a29","Type":"ContainerStarted","Data":"c3274a2f1d56790a2ef8e85f8cc42e2889dbdafbd44b792e672e6e2768c2b70a"} Aug 05 12:20:02.410876 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.410860 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:20:02.475086 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475009 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-installation-pull-secrets\") pod \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " Aug 05 12:20:02.475086 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475045 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-bound-sa-token\") pod \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " Aug 05 12:20:02.475086 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475079 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-trusted-ca\") pod \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " Aug 05 12:20:02.475377 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475103 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-ca-trust-extracted\") pod \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " Aug 05 12:20:02.475377 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475159 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6js5\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-kube-api-access-h6js5\") pod \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " Aug 05 12:20:02.475377 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475193 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-certificates\") pod \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " Aug 05 12:20:02.475377 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475220 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-image-registry-private-configuration\") pod \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " Aug 05 12:20:02.475377 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475316 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a2a686b-0758-4afc-a1b8-c2074bd13187-trusted-ca\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.475377 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475364 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a2a686b-0758-4afc-a1b8-c2074bd13187-image-registry-private-configuration\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475391 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a2a686b-0758-4afc-a1b8-c2074bd13187-installation-pull-secrets\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-registry-tls\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a2a686b-0758-4afc-a1b8-c2074bd13187-ca-trust-extracted\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475486 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475527 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-bound-sa-token\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hch7\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-kube-api-access-6hch7\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475574 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475584 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:20:02.475668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a2a686b-0758-4afc-a1b8-c2074bd13187-registry-certificates\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.476159 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475704 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-certificates\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:20:02.476159 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475722 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-trusted-ca\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:20:02.476159 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.475735 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-ca-trust-extracted\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:20:02.476623 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.476597 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a2a686b-0758-4afc-a1b8-c2074bd13187-registry-certificates\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.476947 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.476924 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a2a686b-0758-4afc-a1b8-c2074bd13187-ca-trust-extracted\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.477108 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.477081 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a2a686b-0758-4afc-a1b8-c2074bd13187-trusted-ca\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.477822 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.477757 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-kube-api-access-h6js5" (OuterVolumeSpecName: "kube-api-access-h6js5") pod "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0"). InnerVolumeSpecName "kube-api-access-h6js5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 12:20:02.477822 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.477781 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 12:20:02.477995 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.477960 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:20:02.478115 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.478082 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:20:02.478548 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.478516 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a2a686b-0758-4afc-a1b8-c2074bd13187-image-registry-private-configuration\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.479442 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.479424 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-registry-tls\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.479546 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.479530 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a2a686b-0758-4afc-a1b8-c2074bd13187-installation-pull-secrets\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.487775 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.487747 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hch7\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-kube-api-access-6hch7\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.487912 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.487852 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a2a686b-0758-4afc-a1b8-c2074bd13187-bound-sa-token\") pod \"image-registry-5749d664f8-6brsx\" (UID: \"0a2a686b-0758-4afc-a1b8-c2074bd13187\") " pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.531957 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.531919 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:02.576362 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.576331 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-bound-sa-token\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:20:02.576362 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.576358 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6js5\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-kube-api-access-h6js5\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:20:02.576362 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.576368 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-image-registry-private-configuration\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:20:02.576590 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.576377 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-installation-pull-secrets\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:20:02.644623 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.644597 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vkpqd\"" Aug 05 12:20:02.653369 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.653343 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:02.661206 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.661180 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc"] Aug 05 12:20:02.664479 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:02.664454 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdaa28b8_08d0_4d8d_9e80_14e0adecf684.slice/crio-27c41099b3b58801c3e0827029f101bb5375903b57f0b2f7edce7e3d18556a87 WatchSource:0}: Error finding container 27c41099b3b58801c3e0827029f101bb5375903b57f0b2f7edce7e3d18556a87: Status 404 returned error can't find the container with id 27c41099b3b58801c3e0827029f101bb5375903b57f0b2f7edce7e3d18556a87 Aug 05 12:20:02.793415 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:02.793381 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5749d664f8-6brsx"] Aug 05 12:20:02.798438 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:02.798408 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2a686b_0758_4afc_a1b8_c2074bd13187.slice/crio-64520413a83f7497be51aeb290d93ea1ecaa63ff9dacea42f87b5dbf2fdf4329 WatchSource:0}: Error finding container 64520413a83f7497be51aeb290d93ea1ecaa63ff9dacea42f87b5dbf2fdf4329: Status 404 returned error can't find the container with id 64520413a83f7497be51aeb290d93ea1ecaa63ff9dacea42f87b5dbf2fdf4329 Aug 05 12:20:03.282573 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.282526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:20:03.282760 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.282594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:20:03.287344 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.287264 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa9b57fb-914f-4754-9167-137c1d12b79c-metrics-tls\") pod \"dns-default-s27hp\" (UID: \"aa9b57fb-914f-4754-9167-137c1d12b79c\") " pod="openshift-dns/dns-default-s27hp" Aug 05 12:20:03.288703 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.288638 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"image-registry-76c8cdc7bf-fz5rw\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:20:03.383997 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.383962 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") pod \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\" (UID: \"1e2f5221-f826-4d9b-8b9e-61c7db3ffce0\") " Aug 05 12:20:03.387791 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.387753 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" (UID: "1e2f5221-f826-4d9b-8b9e-61c7db3ffce0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 12:20:03.413828 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.413203 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5749d664f8-6brsx" event={"ID":"0a2a686b-0758-4afc-a1b8-c2074bd13187","Type":"ContainerStarted","Data":"005358e8ab5785faa9f333df3e758b4710c2d9c635bb85820c95c251d8ec463f"} Aug 05 12:20:03.413828 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.413263 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5749d664f8-6brsx" event={"ID":"0a2a686b-0758-4afc-a1b8-c2074bd13187","Type":"ContainerStarted","Data":"64520413a83f7497be51aeb290d93ea1ecaa63ff9dacea42f87b5dbf2fdf4329"} Aug 05 12:20:03.413828 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.413575 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:03.415229 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.415196 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" event={"ID":"bdaa28b8-08d0-4d8d-9e80-14e0adecf684","Type":"ContainerStarted","Data":"27c41099b3b58801c3e0827029f101bb5375903b57f0b2f7edce7e3d18556a87"} Aug 05 12:20:03.415229 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.415215 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c8cdc7bf-fz5rw" Aug 05 12:20:03.434967 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.434902 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5749d664f8-6brsx" podStartSLOduration=1.434879987 podStartE2EDuration="1.434879987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:03.43434893 +0000 UTC m=+66.945019999" watchObservedRunningTime="2026-08-05 12:20:03.434879987 +0000 UTC m=+66.945551055" Aug 05 12:20:03.461221 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.461184 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76c8cdc7bf-fz5rw"] Aug 05 12:20:03.464540 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.464506 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76c8cdc7bf-fz5rw"] Aug 05 12:20:03.485903 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.485869 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0-registry-tls\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:20:03.533678 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.533480 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4c62j\"" Aug 05 12:20:03.542457 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.542238 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s27hp" Aug 05 12:20:03.737093 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:03.737038 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s27hp"] Aug 05 12:20:04.001382 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:04.001346 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9b57fb_914f_4754_9167_137c1d12b79c.slice/crio-d39579b0d174b64a95dcf4613d38ab0a90f1d2b3d6d53061ed3aabbd7a0f9032 WatchSource:0}: Error finding container d39579b0d174b64a95dcf4613d38ab0a90f1d2b3d6d53061ed3aabbd7a0f9032: Status 404 returned error can't find the container with id d39579b0d174b64a95dcf4613d38ab0a90f1d2b3d6d53061ed3aabbd7a0f9032 Aug 05 12:20:04.426323 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:04.426257 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s27hp" event={"ID":"aa9b57fb-914f-4754-9167-137c1d12b79c","Type":"ContainerStarted","Data":"d39579b0d174b64a95dcf4613d38ab0a90f1d2b3d6d53061ed3aabbd7a0f9032"} Aug 05 12:20:05.035384 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.035149 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2f5221-f826-4d9b-8b9e-61c7db3ffce0" path="/var/lib/kubelet/pods/1e2f5221-f826-4d9b-8b9e-61c7db3ffce0/volumes" Aug 05 12:20:05.220639 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.219540 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-n4c2n"] Aug 05 12:20:05.238086 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.237472 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-n4c2n"] Aug 05 12:20:05.238086 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.237595 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-n4c2n" Aug 05 12:20:05.240363 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.240273 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 05 12:20:05.240719 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.240518 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z5nrb\"" Aug 05 12:20:05.240841 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.240754 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 05 12:20:05.300732 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.300641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkz4\" (UniqueName: \"kubernetes.io/projected/15a98b75-f59e-4c96-b0d1-53153d4414a0-kube-api-access-wqkz4\") pod \"downloads-77c974ffcf-n4c2n\" (UID: \"15a98b75-f59e-4c96-b0d1-53153d4414a0\") " pod="openshift-console/downloads-77c974ffcf-n4c2n" Aug 05 12:20:05.401802 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.401739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkz4\" (UniqueName: \"kubernetes.io/projected/15a98b75-f59e-4c96-b0d1-53153d4414a0-kube-api-access-wqkz4\") pod \"downloads-77c974ffcf-n4c2n\" (UID: \"15a98b75-f59e-4c96-b0d1-53153d4414a0\") " pod="openshift-console/downloads-77c974ffcf-n4c2n" Aug 05 12:20:05.429664 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.429587 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkz4\" (UniqueName: \"kubernetes.io/projected/15a98b75-f59e-4c96-b0d1-53153d4414a0-kube-api-access-wqkz4\") pod \"downloads-77c974ffcf-n4c2n\" (UID: \"15a98b75-f59e-4c96-b0d1-53153d4414a0\") " pod="openshift-console/downloads-77c974ffcf-n4c2n" Aug 05 12:20:05.439468 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.436785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcxrc" event={"ID":"dfd0ac47-bc49-46f0-8848-b17a54c9df3a","Type":"ContainerStarted","Data":"23c4d1c635345f68b60117ef7ea8b81967d28bdc8d26101b61b7b864e37c4595"} Aug 05 12:20:05.439468 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.436854 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcxrc" event={"ID":"dfd0ac47-bc49-46f0-8848-b17a54c9df3a","Type":"ContainerStarted","Data":"523b829efd82c785fbcf62266795f84c35f883fff24cc4f050a3447c6203253a"} Aug 05 12:20:05.455843 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.454574 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wcxrc" podStartSLOduration=66.003935012 podStartE2EDuration="1m8.454539768s" totalImagesPullingTime="2.450604756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:05.45434833 +0000 UTC m=+68.965019394" watchObservedRunningTime="2026-08-05 12:20:05.454539768 +0000 UTC m=+68.965210837" Aug 05 12:20:05.550977 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:05.550630 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-n4c2n" Aug 05 12:20:08.302103 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:08.302065 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j"] Aug 05 12:20:08.304920 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:08.304899 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" Aug 05 12:20:08.307272 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:08.307251 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Aug 05 12:20:08.307389 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:08.307319 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fl7t6\"" Aug 05 12:20:08.313441 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:08.313390 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j"] Aug 05 12:20:08.429697 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:08.429662 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f93501b-9432-459e-85c7-892adfbbb59b-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-sx84j\" (UID: \"1f93501b-9432-459e-85c7-892adfbbb59b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" Aug 05 12:20:08.530242 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:08.530209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f93501b-9432-459e-85c7-892adfbbb59b-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-sx84j\" (UID: \"1f93501b-9432-459e-85c7-892adfbbb59b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" Aug 05 12:20:08.530448 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:08.530369 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Aug 05 12:20:08.530516 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:08.530454 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f93501b-9432-459e-85c7-892adfbbb59b-tls-certificates podName:1f93501b-9432-459e-85c7-892adfbbb59b nodeName:}" failed. No retries permitted until 2026-08-05 12:20:09.030431716 +0000 UTC m=+72.541102769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1f93501b-9432-459e-85c7-892adfbbb59b-tls-certificates") pod "prometheus-operator-admission-webhook-66685ff6d4-sx84j" (UID: "1f93501b-9432-459e-85c7-892adfbbb59b") : secret "prometheus-operator-admission-webhook-tls" not found Aug 05 12:20:09.034636 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:09.034601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f93501b-9432-459e-85c7-892adfbbb59b-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-sx84j\" (UID: \"1f93501b-9432-459e-85c7-892adfbbb59b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" Aug 05 12:20:09.037255 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:09.037233 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1f93501b-9432-459e-85c7-892adfbbb59b-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-sx84j\" (UID: \"1f93501b-9432-459e-85c7-892adfbbb59b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" Aug 05 12:20:09.217732 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:09.217673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" Aug 05 12:20:10.358640 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.358615 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-n4c2n"] Aug 05 12:20:10.367045 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.367019 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j"] Aug 05 12:20:10.457275 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.457239 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-n4c2n" event={"ID":"15a98b75-f59e-4c96-b0d1-53153d4414a0","Type":"ContainerStarted","Data":"269e51ff22e8cca5b53c60f71419fe328098f8e5874b8b8d2498a04d5606120a"} Aug 05 12:20:10.459806 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.459135 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" event={"ID":"bdaa28b8-08d0-4d8d-9e80-14e0adecf684","Type":"ContainerStarted","Data":"fbd21a061711d9e4b0f5d80de134760c30d1ce94131ae3b8bcc8b8b8c4be6406"} Aug 05 12:20:10.459806 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.459761 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:10.461262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.461222 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" Aug 05 12:20:10.461955 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.461927 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s27hp" event={"ID":"aa9b57fb-914f-4754-9167-137c1d12b79c","Type":"ContainerStarted","Data":"f7896a48b9005a989e4f7ec14629a8ea23a314b5d4241c1f6554c18f76e84174"} Aug 05 12:20:10.465544 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.465518 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6m4tz" event={"ID":"636d0bb5-96fa-410a-b1c1-c613d11e9a29","Type":"ContainerStarted","Data":"bd9c4dfb39b9bbdb1c95c6b54ca8a2cf391dc392fec4561720b192364080e397"} Aug 05 12:20:10.465659 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.465586 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:20:10.466524 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.466504 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" event={"ID":"1f93501b-9432-459e-85c7-892adfbbb59b","Type":"ContainerStarted","Data":"fff0382184695023098739b6519fbaf22ee09d29ced1c93b7009b99ac9257122"} Aug 05 12:20:10.467554 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.467530 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kqsfn" event={"ID":"72a568d6-8cc6-4dd4-9c93-2c1393198783","Type":"ContainerStarted","Data":"91df71999486f3c0ee7668f52ec9457644280314c4f8298c61821c1779e19832"} Aug 05 12:20:10.484459 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.484277 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5b99765cf-9p2gc" podStartSLOduration=0.870566829 podStartE2EDuration="8.484259443s" totalImagesPullingTime="7.613692614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:10.482535112 +0000 UTC m=+73.993206180" watchObservedRunningTime="2026-08-05 12:20:10.484259443 +0000 UTC m=+73.994930511" Aug 05 12:20:10.530607 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.530539 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kqsfn" podStartSLOduration=65.289476634 podStartE2EDuration="1m13.530522702s" totalImagesPullingTime="8.241046068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:10.530436115 +0000 UTC m=+74.041107203" watchObservedRunningTime="2026-08-05 12:20:10.530522702 +0000 UTC m=+74.041193769" Aug 05 12:20:10.559677 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:10.559630 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6m4tz" podStartSLOduration=65.541902786 podStartE2EDuration="1m13.559612646s" totalImagesPullingTime="8.01770986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:10.558831802 +0000 UTC m=+74.069502890" watchObservedRunningTime="2026-08-05 12:20:10.559612646 +0000 UTC m=+74.070283751" Aug 05 12:20:11.476093 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:11.476012 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s27hp" event={"ID":"aa9b57fb-914f-4754-9167-137c1d12b79c","Type":"ContainerStarted","Data":"b097e8c17029feb42b592da7c071e3d6543f969d6ea163180d85b23355e8f7ed"} Aug 05 12:20:11.498128 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:11.498073 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s27hp" podStartSLOduration=34.298297929 podStartE2EDuration="40.498052636s" totalImagesPullingTime="6.199754707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:11.496041945 +0000 UTC m=+75.006713024" watchObservedRunningTime="2026-08-05 12:20:11.498052636 +0000 UTC m=+75.008723705" Aug 05 12:20:12.482227 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:12.482174 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" event={"ID":"1f93501b-9432-459e-85c7-892adfbbb59b","Type":"ContainerStarted","Data":"942e4b2da385fb9af2fbf283d47ba773516868419bba95d0ff4e6c12ed902f1c"} Aug 05 12:20:12.482723 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:12.482639 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" Aug 05 12:20:12.482723 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:12.482668 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s27hp" Aug 05 12:20:12.487684 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:12.487661 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" Aug 05 12:20:12.498434 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:12.498392 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-sx84j" podStartSLOduration=3.231196334 podStartE2EDuration="4.498378241s" totalImagesPullingTime="1.267181907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:12.497347345 +0000 UTC m=+76.008018415" watchObservedRunningTime="2026-08-05 12:20:12.498378241 +0000 UTC m=+76.009049308" Aug 05 12:20:13.363022 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.362985 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4x9qv"] Aug 05 12:20:13.366631 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.366604 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.368919 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.368897 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 05 12:20:13.370163 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.369949 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Aug 05 12:20:13.370163 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.369970 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 05 12:20:13.370163 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.370070 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 05 12:20:13.370163 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.369971 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Aug 05 12:20:13.370452 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.370287 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f84cp\"" Aug 05 12:20:13.375858 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.375835 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4x9qv"] Aug 05 12:20:13.470761 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.470723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g246p\" (UniqueName: \"kubernetes.io/projected/697d01d0-2052-4bcc-813c-9838f8caa26a-kube-api-access-g246p\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.470761 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.470763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697d01d0-2052-4bcc-813c-9838f8caa26a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.470999 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.470859 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.470999 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.470902 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.571668 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.571630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g246p\" (UniqueName: \"kubernetes.io/projected/697d01d0-2052-4bcc-813c-9838f8caa26a-kube-api-access-g246p\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.572112 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.571686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697d01d0-2052-4bcc-813c-9838f8caa26a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.572112 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.572045 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.572112 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.572078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.572285 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:13.572193 2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Aug 05 12:20:13.572285 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:13.572254 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-tls podName:697d01d0-2052-4bcc-813c-9838f8caa26a nodeName:}" failed. No retries permitted until 2026-08-05 12:20:14.072235163 +0000 UTC m=+77.582906223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-4x9qv" (UID: "697d01d0-2052-4bcc-813c-9838f8caa26a") : secret "prometheus-operator-tls" not found Aug 05 12:20:13.572540 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.572514 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/697d01d0-2052-4bcc-813c-9838f8caa26a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.574527 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.574503 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:13.580321 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:13.580271 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g246p\" (UniqueName: \"kubernetes.io/projected/697d01d0-2052-4bcc-813c-9838f8caa26a-kube-api-access-g246p\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:14.076349 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:14.076284 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:14.079134 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:14.079099 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/697d01d0-2052-4bcc-813c-9838f8caa26a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-4x9qv\" (UID: \"697d01d0-2052-4bcc-813c-9838f8caa26a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:14.279061 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:14.279024 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" Aug 05 12:20:14.421887 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:14.421853 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-4x9qv"] Aug 05 12:20:14.425232 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:14.425206 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697d01d0_2052_4bcc_813c_9838f8caa26a.slice/crio-3a460da6de1c4e08301e5de8d23c2c7c5e80406733652489176e0841c89199ca WatchSource:0}: Error finding container 3a460da6de1c4e08301e5de8d23c2c7c5e80406733652489176e0841c89199ca: Status 404 returned error can't find the container with id 3a460da6de1c4e08301e5de8d23c2c7c5e80406733652489176e0841c89199ca Aug 05 12:20:14.490841 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:14.490807 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" event={"ID":"697d01d0-2052-4bcc-813c-9838f8caa26a","Type":"ContainerStarted","Data":"3a460da6de1c4e08301e5de8d23c2c7c5e80406733652489176e0841c89199ca"} Aug 05 12:20:15.969387 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.969355 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57674bc75b-fzfx9"] Aug 05 12:20:15.973184 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.972463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:15.975064 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.974910 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7bdrz\"" Aug 05 12:20:15.975064 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.974934 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 05 12:20:15.975462 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.975136 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 05 12:20:15.975462 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.975234 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 05 12:20:15.975595 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.975549 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 05 12:20:15.975788 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.975774 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 05 12:20:15.984896 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:15.983121 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57674bc75b-fzfx9"] Aug 05 12:20:16.092527 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.092433 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-serving-cert\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.092527 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.092514 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-console-config\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.092766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.092543 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-oauth-serving-cert\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.092766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.092596 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67xmb\" (UniqueName: \"kubernetes.io/projected/0196a164-0899-4a06-8c92-5b5f6e92f475-kube-api-access-67xmb\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.092766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.092628 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-oauth-config\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.092766 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.092650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-service-ca\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.193554 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.193509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67xmb\" (UniqueName: \"kubernetes.io/projected/0196a164-0899-4a06-8c92-5b5f6e92f475-kube-api-access-67xmb\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.193554 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.193551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-oauth-config\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.193791 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.193578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-service-ca\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.193791 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.193609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-serving-cert\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.193791 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.193663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-console-config\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.193791 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.193684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-oauth-serving-cert\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.194536 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.194507 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-service-ca\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.194536 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.194511 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-oauth-serving-cert\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.194888 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.194841 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-console-config\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.196420 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.196395 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-oauth-config\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.196504 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.196443 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-serving-cert\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.201365 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.201341 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67xmb\" (UniqueName: \"kubernetes.io/projected/0196a164-0899-4a06-8c92-5b5f6e92f475-kube-api-access-67xmb\") pod \"console-57674bc75b-fzfx9\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.288912 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.288883 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:16.436999 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.436948 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57674bc75b-fzfx9"] Aug 05 12:20:16.440208 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:16.440182 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0196a164_0899_4a06_8c92_5b5f6e92f475.slice/crio-aced2924efbbf108f924157788490e17f76124faffeb69a5e1bb43c4684d0d23 WatchSource:0}: Error finding container aced2924efbbf108f924157788490e17f76124faffeb69a5e1bb43c4684d0d23: Status 404 returned error can't find the container with id aced2924efbbf108f924157788490e17f76124faffeb69a5e1bb43c4684d0d23 Aug 05 12:20:16.500953 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.500906 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" event={"ID":"697d01d0-2052-4bcc-813c-9838f8caa26a","Type":"ContainerStarted","Data":"2fe9e7a8b536761acf5e125bfa19257f8fc6a0778acd62740ce919b3707544cf"} Aug 05 12:20:16.501127 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.500974 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" event={"ID":"697d01d0-2052-4bcc-813c-9838f8caa26a","Type":"ContainerStarted","Data":"977299a961a6de04b9691c6d356c838b10b5f2e72dce6ac67604c7ca03b3bf48"} Aug 05 12:20:16.502522 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.502495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57674bc75b-fzfx9" event={"ID":"0196a164-0899-4a06-8c92-5b5f6e92f475","Type":"ContainerStarted","Data":"aced2924efbbf108f924157788490e17f76124faffeb69a5e1bb43c4684d0d23"} Aug 05 12:20:16.521206 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:16.521159 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-4x9qv" podStartSLOduration=2.107388533 podStartE2EDuration="3.521142797s" totalImagesPullingTime="1.413754264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:16.520426799 +0000 UTC m=+80.031097867" watchObservedRunningTime="2026-08-05 12:20:16.521142797 +0000 UTC m=+80.031813864" Aug 05 12:20:18.727903 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.727760 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg"] Aug 05 12:20:18.739327 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.738598 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.743165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.743108 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Aug 05 12:20:18.744576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.743726 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-222ft\"" Aug 05 12:20:18.744576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.743959 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Aug 05 12:20:18.758763 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.757691 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg"] Aug 05 12:20:18.766473 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.766448 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zzvrm"] Aug 05 12:20:18.770167 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.770149 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.774964 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.774834 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 05 12:20:18.781291 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.781191 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 05 12:20:18.781869 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.781418 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dwmqg\"" Aug 05 12:20:18.781869 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.781455 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 05 12:20:18.815272 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.815120 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.815272 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.815180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtb9c\" (UniqueName: \"kubernetes.io/projected/5e802fd6-de14-4714-a1bc-8bde5740c18d-kube-api-access-rtb9c\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.815272 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.815225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.815558 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.815311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e802fd6-de14-4714-a1bc-8bde5740c18d-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.916750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.916804 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-textfile\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.916878 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.916914 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwng5\" (UniqueName: \"kubernetes.io/projected/04062a1d-d106-4f55-9209-7dce86e19878-kube-api-access-kwng5\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.916942 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-wtmp\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.916972 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-tls\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.916998 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-root\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.917032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtb9c\" (UniqueName: \"kubernetes.io/projected/5e802fd6-de14-4714-a1bc-8bde5740c18d-kube-api-access-rtb9c\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.917084 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.917118 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e802fd6-de14-4714-a1bc-8bde5740c18d-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.917142 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-sys\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.917180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.917205 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.917205 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04062a1d-d106-4f55-9209-7dce86e19878-metrics-client-ca\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:18.918568 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:18.918254 2560 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Aug 05 12:20:18.918568 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:18.918348 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-tls podName:5e802fd6-de14-4714-a1bc-8bde5740c18d nodeName:}" failed. No retries permitted until 2026-08-05 12:20:19.418326786 +0000 UTC m=+82.928997831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-7h4sg" (UID: "5e802fd6-de14-4714-a1bc-8bde5740c18d") : secret "openshift-state-metrics-tls" not found Aug 05 12:20:18.918841 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.918822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e802fd6-de14-4714-a1bc-8bde5740c18d-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.923840 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.923811 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:18.929350 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:18.929288 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtb9c\" (UniqueName: \"kubernetes.io/projected/5e802fd6-de14-4714-a1bc-8bde5740c18d-kube-api-access-rtb9c\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:19.017993 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.017896 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-sys\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.017993 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.017955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.017993 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.017982 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04062a1d-d106-4f55-9209-7dce86e19878-metrics-client-ca\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018005 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-sys\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-textfile\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwng5\" (UniqueName: \"kubernetes.io/projected/04062a1d-d106-4f55-9209-7dce86e19878-kube-api-access-kwng5\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-wtmp\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-tls\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-root\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018262 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018247 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-root\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018747 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018724 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04062a1d-d106-4f55-9209-7dce86e19878-metrics-client-ca\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.018984 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018964 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-textfile\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.019170 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.019150 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-wtmp\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.019262 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:19.019246 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Aug 05 12:20:19.019331 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.018734 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.019386 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:20:19.019331 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-tls podName:04062a1d-d106-4f55-9209-7dce86e19878 nodeName:}" failed. No retries permitted until 2026-08-05 12:20:19.519290214 +0000 UTC m=+83.029961261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-tls") pod "node-exporter-zzvrm" (UID: "04062a1d-d106-4f55-9209-7dce86e19878") : secret "node-exporter-tls" not found Aug 05 12:20:19.022122 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.022073 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.029467 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.029437 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwng5\" (UniqueName: \"kubernetes.io/projected/04062a1d-d106-4f55-9209-7dce86e19878-kube-api-access-kwng5\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.421779 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.421600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:19.425136 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.425081 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e802fd6-de14-4714-a1bc-8bde5740c18d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7h4sg\" (UID: \"5e802fd6-de14-4714-a1bc-8bde5740c18d\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:19.522986 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.522952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-tls\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.525719 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.525684 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04062a1d-d106-4f55-9209-7dce86e19878-node-exporter-tls\") pod \"node-exporter-zzvrm\" (UID: \"04062a1d-d106-4f55-9209-7dce86e19878\") " pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:19.652425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.652379 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" Aug 05 12:20:19.684489 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:19.684399 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzvrm" Aug 05 12:20:21.777245 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.777212 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-74cd8457b9-clvqj"] Aug 05 12:20:21.781189 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.781161 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:21.784116 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.784090 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Aug 05 12:20:21.784240 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.784116 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1cgfm3cnkqkcu\"" Aug 05 12:20:21.784335 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.784246 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Aug 05 12:20:21.784765 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.784746 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-88r5c\"" Aug 05 12:20:21.784857 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.784795 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Aug 05 12:20:21.784954 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.784937 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Aug 05 12:20:21.785041 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.785026 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Aug 05 12:20:21.797199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.797171 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74cd8457b9-clvqj"] Aug 05 12:20:21.946115 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.946072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-tls\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:21.946322 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.946168 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/495f709d-df39-4490-bd9a-364ece8ba6c1-metrics-client-ca\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:21.946322 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.946203 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-grpc-tls\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:21.946322 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.946237 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:21.946322 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.946270 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:21.946541 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.946380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:21.946541 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.946430 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hb8r\" (UniqueName: \"kubernetes.io/projected/495f709d-df39-4490-bd9a-364ece8ba6c1-kube-api-access-6hb8r\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:21.946541 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:21.946467 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.048721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.047518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/495f709d-df39-4490-bd9a-364ece8ba6c1-metrics-client-ca\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.048721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.047561 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-grpc-tls\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.048721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.047593 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.048721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.047628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.048721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.047663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.048721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.047701 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hb8r\" (UniqueName: \"kubernetes.io/projected/495f709d-df39-4490-bd9a-364ece8ba6c1-kube-api-access-6hb8r\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.048721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.047733 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.048721 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.047772 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-tls\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.049794 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.049736 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/495f709d-df39-4490-bd9a-364ece8ba6c1-metrics-client-ca\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.052169 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.052121 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-tls\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.053153 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.053128 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.054318 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.054267 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.054410 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.054359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.054581 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.054557 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-grpc-tls\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.054818 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.054791 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/495f709d-df39-4490-bd9a-364ece8ba6c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.057279 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.057261 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hb8r\" (UniqueName: \"kubernetes.io/projected/495f709d-df39-4490-bd9a-364ece8ba6c1-kube-api-access-6hb8r\") pod \"thanos-querier-74cd8457b9-clvqj\" (UID: \"495f709d-df39-4490-bd9a-364ece8ba6c1\") " pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.094308 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.094273 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:22.488252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.488217 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s27hp" Aug 05 12:20:22.658415 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.658367 2560 patch_prober.go:28] interesting pod/image-registry-5749d664f8-6brsx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Aug 05 12:20:22.658584 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:22.658441 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5749d664f8-6brsx" podUID="0a2a686b-0758-4afc-a1b8-c2074bd13187" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 12:20:24.431369 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.431340 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5749d664f8-6brsx" Aug 05 12:20:24.952145 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.952109 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:20:24.962244 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.962202 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:24.966403 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.966285 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sq86k\"" Aug 05 12:20:24.966571 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.966553 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 05 12:20:24.966958 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.966934 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 05 12:20:24.967061 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.967029 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 05 12:20:24.967233 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.967218 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 05 12:20:24.967275 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.967244 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 05 12:20:24.967454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.967435 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 05 12:20:24.967454 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.967451 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 05 12:20:24.967628 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.967487 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 05 12:20:24.967628 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.967579 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ckb5doh74t07g\"" Aug 05 12:20:24.967725 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.967660 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 05 12:20:24.968122 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.968067 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 05 12:20:24.968122 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.968135 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 05 12:20:24.969391 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.968433 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 05 12:20:24.969391 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.968923 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 05 12:20:24.970395 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.970376 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 05 12:20:24.975952 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.973814 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 05 12:20:24.989730 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:24.989699 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:20:25.083063 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083256 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083086 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083256 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083110 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083256 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083256 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083450 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083271 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083450 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083291 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083450 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083357 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083450 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083450 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083430 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083657 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083453 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083657 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083657 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083508 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk8fc\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-kube-api-access-mk8fc\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083657 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083538 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083657 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083560 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083657 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083657 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083645 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083940 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083940 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.083940 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.083721 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184581 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184541 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184737 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184737 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184737 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184669 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184737 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184694 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk8fc\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-kube-api-access-mk8fc\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184737 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184749 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184825 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184879 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.184962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184955 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.185362 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.184977 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.185362 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.185015 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.185362 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.185048 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.185825 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.185799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.185913 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.185853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.185913 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.185887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.186033 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.185950 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.186446 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.186099 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.187237 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.187210 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.187747 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.187721 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.189693 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.188662 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.189693 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.189259 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.189693 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.189602 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.189693 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.189655 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.191162 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.190685 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.192221 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.192198 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.193021 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.192996 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.193392 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.193357 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.193589 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.193433 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.195318 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.193889 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.195318 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.194441 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.195318 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.194848 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.195318 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.195242 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.195318 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.195286 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.196809 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.196765 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk8fc\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-kube-api-access-mk8fc\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.196908 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.196863 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:25.279068 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:25.278975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:27.855926 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:27.855887 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg"] Aug 05 12:20:27.859027 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:27.858996 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e802fd6_de14_4714_a1bc_8bde5740c18d.slice/crio-d008bbd9ebbd5c4334ba46b17360b5904486537804d2fcbe47237f9bf335a50a WatchSource:0}: Error finding container d008bbd9ebbd5c4334ba46b17360b5904486537804d2fcbe47237f9bf335a50a: Status 404 returned error can't find the container with id d008bbd9ebbd5c4334ba46b17360b5904486537804d2fcbe47237f9bf335a50a Aug 05 12:20:28.087714 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.087588 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-74cd8457b9-clvqj"] Aug 05 12:20:28.093192 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.093151 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:20:28.101592 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:20:28.101554 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a530d4a_a752_41f6_bd39_0b95cce8bf6b.slice/crio-af0d73cb1ed56d75435a1ade4a9577aa2643ce4f389f46406335d29acdfc7fb3 WatchSource:0}: Error finding container af0d73cb1ed56d75435a1ade4a9577aa2643ce4f389f46406335d29acdfc7fb3: Status 404 returned error can't find the container with id af0d73cb1ed56d75435a1ade4a9577aa2643ce4f389f46406335d29acdfc7fb3 Aug 05 12:20:28.555986 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.555946 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerStarted","Data":"af0d73cb1ed56d75435a1ade4a9577aa2643ce4f389f46406335d29acdfc7fb3"} Aug 05 12:20:28.559105 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.559072 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-n4c2n" event={"ID":"15a98b75-f59e-4c96-b0d1-53153d4414a0","Type":"ContainerStarted","Data":"c2455bc8997597b3d0312abce713ec03473ab76393c9f39bc3b23a1111db4632"} Aug 05 12:20:28.559464 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.559435 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-n4c2n" Aug 05 12:20:28.563823 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.563797 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57674bc75b-fzfx9" event={"ID":"0196a164-0899-4a06-8c92-5b5f6e92f475","Type":"ContainerStarted","Data":"fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb"} Aug 05 12:20:28.566028 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.566006 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzvrm" event={"ID":"04062a1d-d106-4f55-9209-7dce86e19878","Type":"ContainerStarted","Data":"2c2376bccb4449056270b815f700fb9629cbd6aad51db5c045b552697569975e"} Aug 05 12:20:28.568256 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.568230 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" event={"ID":"495f709d-df39-4490-bd9a-364ece8ba6c1","Type":"ContainerStarted","Data":"74b921282793047ff490ba2d3be49d8fa41501fd59520762fee6ff42b28caa7d"} Aug 05 12:20:28.571020 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.570985 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" event={"ID":"5e802fd6-de14-4714-a1bc-8bde5740c18d","Type":"ContainerStarted","Data":"cd7ceac7b9ff22f96da927b7729ad165e64beb40d39dee78f71b14e2f53ebabb"} Aug 05 12:20:28.571187 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.571097 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" event={"ID":"5e802fd6-de14-4714-a1bc-8bde5740c18d","Type":"ContainerStarted","Data":"02abd019433239bb449a1d913eae59c62b84c0b967881daa420262196ed306a5"} Aug 05 12:20:28.571187 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.571131 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" event={"ID":"5e802fd6-de14-4714-a1bc-8bde5740c18d","Type":"ContainerStarted","Data":"d008bbd9ebbd5c4334ba46b17360b5904486537804d2fcbe47237f9bf335a50a"} Aug 05 12:20:28.574798 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.574776 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-n4c2n" Aug 05 12:20:28.576893 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:28.576786 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-n4c2n" podStartSLOduration=6.184058266 podStartE2EDuration="23.576767308s" totalImagesPullingTime="17.392709042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:28.575011299 +0000 UTC m=+92.085682367" watchObservedRunningTime="2026-08-05 12:20:28.576767308 +0000 UTC m=+92.087438379" Aug 05 12:20:30.584909 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:30.584860 2560 generic.go:356] "Generic (PLEG): container finished" podID="04062a1d-d106-4f55-9209-7dce86e19878" containerID="430c7e77a80670e63cfbfb0ca93f2be27f86740a5ba55c16ae75bfcbdc7a8375" exitCode=0 Aug 05 12:20:30.585517 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:30.585370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzvrm" event={"ID":"04062a1d-d106-4f55-9209-7dce86e19878","Type":"ContainerDied","Data":"430c7e77a80670e63cfbfb0ca93f2be27f86740a5ba55c16ae75bfcbdc7a8375"} Aug 05 12:20:30.590272 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:30.590231 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" event={"ID":"5e802fd6-de14-4714-a1bc-8bde5740c18d","Type":"ContainerStarted","Data":"1655df507f9721ef3072f272309bccdb7123590b4f48571db687e1965d494237"} Aug 05 12:20:30.605439 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:30.605376 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57674bc75b-fzfx9" podStartSLOduration=4.364537765 podStartE2EDuration="15.605353359s" totalImagesPullingTime="11.240815594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:28.614991062 +0000 UTC m=+92.125662130" watchObservedRunningTime="2026-08-05 12:20:30.605353359 +0000 UTC m=+94.116024428" Aug 05 12:20:30.621877 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:30.621815 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7h4sg" podStartSLOduration=10.183014982 podStartE2EDuration="12.621795619s" totalImagesPullingTime="2.438780637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:30.621144851 +0000 UTC m=+94.131815930" watchObservedRunningTime="2026-08-05 12:20:30.621795619 +0000 UTC m=+94.132466691" Aug 05 12:20:32.601359 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:32.601258 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" exitCode=0 Aug 05 12:20:32.601359 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:32.601341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerDied","Data":"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6"} Aug 05 12:20:32.604358 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:32.604204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzvrm" event={"ID":"04062a1d-d106-4f55-9209-7dce86e19878","Type":"ContainerStarted","Data":"93b69ca12c0ad6916268a25eb84edb1c5bedd90248f52b83d42402b4ccc6b93c"} Aug 05 12:20:32.604358 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:32.604254 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzvrm" event={"ID":"04062a1d-d106-4f55-9209-7dce86e19878","Type":"ContainerStarted","Data":"e42a33af6abcc6404876b73327bbefdfad6f7da28e70f169279532ea2cb807dc"} Aug 05 12:20:32.606756 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:32.606728 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" event={"ID":"495f709d-df39-4490-bd9a-364ece8ba6c1","Type":"ContainerStarted","Data":"47100b5c6fca1c1fcd92ee5e9323332f58c0857be72cd3e00c651f21194c013e"} Aug 05 12:20:32.606852 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:32.606785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" event={"ID":"495f709d-df39-4490-bd9a-364ece8ba6c1","Type":"ContainerStarted","Data":"bcd8f5b9df07ec00bdce4fe0a63031e0f08ded6c3d28fcdf7bef617292301e7b"} Aug 05 12:20:32.606852 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:32.606820 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" event={"ID":"495f709d-df39-4490-bd9a-364ece8ba6c1","Type":"ContainerStarted","Data":"f037e8362cb696470960df5bb1c9ed35d74fe449afb489a2d8a03665cae84e99"} Aug 05 12:20:32.646046 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:32.645992 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zzvrm" podStartSLOduration=12.584010789 podStartE2EDuration="14.645974315s" totalImagesPullingTime="1.926862044s" totalInitContainerRuntime="135.101482ms" isStatefulPod=true podCreationTimestamp="2026-08-05 12:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:32.645107073 +0000 UTC m=+96.155778151" watchObservedRunningTime="2026-08-05 12:20:32.645974315 +0000 UTC m=+96.156645383" Aug 05 12:20:34.622529 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:34.622484 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" event={"ID":"495f709d-df39-4490-bd9a-364ece8ba6c1","Type":"ContainerStarted","Data":"d71931b9729bc41c4b6fcabf33942290e4fb13a398e84cfe01b7e054783ebe51"} Aug 05 12:20:34.623193 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:34.622579 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" event={"ID":"495f709d-df39-4490-bd9a-364ece8ba6c1","Type":"ContainerStarted","Data":"b9e71289fc0264768dc46c1c0d8207a8a9f5bfd288bba6e24a2f29f5bc7cd983"} Aug 05 12:20:34.623193 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:34.622662 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" event={"ID":"495f709d-df39-4490-bd9a-364ece8ba6c1","Type":"ContainerStarted","Data":"3c691ab4fca34b581c4f0335d0d1339f9d5c95d7bcd0ab1d5a712cf178401db3"} Aug 05 12:20:34.623649 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:34.623591 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:34.650827 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:34.650367 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" podStartSLOduration=8.382206374 podStartE2EDuration="13.650344927s" totalImagesPullingTime="5.268138553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:34.64934842 +0000 UTC m=+98.160019488" watchObservedRunningTime="2026-08-05 12:20:34.650344927 +0000 UTC m=+98.161016001" Aug 05 12:20:36.289033 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:36.288995 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:36.289494 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:36.289062 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:36.294561 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:36.294532 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:36.637318 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:36.637270 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:20:37.116606 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:37.116579 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57674bc75b-fzfx9"] Aug 05 12:20:37.640160 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:37.640129 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerStarted","Data":"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763"} Aug 05 12:20:37.640633 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:37.640194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerStarted","Data":"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af"} Aug 05 12:20:37.640633 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:37.640223 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerStarted","Data":"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805"} Aug 05 12:20:37.640633 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:37.640246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerStarted","Data":"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0"} Aug 05 12:20:37.640633 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:37.640271 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerStarted","Data":"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0"} Aug 05 12:20:37.640633 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:37.640293 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerStarted","Data":"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296"} Aug 05 12:20:37.673387 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:37.673341 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.23537685 podStartE2EDuration="13.673324842s" totalImagesPullingTime="7.415023443s" totalInitContainerRuntime="22.924549ms" isStatefulPod=false podCreationTimestamp="2026-08-05 12:20:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:20:37.670981769 +0000 UTC m=+101.181652838" watchObservedRunningTime="2026-08-05 12:20:37.673324842 +0000 UTC m=+101.183995903" Aug 05 12:20:40.279875 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:40.279829 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:20:41.478236 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:41.478203 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6m4tz" Aug 05 12:20:41.639719 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:41.639694 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-74cd8457b9-clvqj" Aug 05 12:20:46.966072 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:20:46.966012 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jpnjw_dbe02a6d-47a2-419f-bc5f-803a6a8ce98e/serve-healthcheck-canary/0.log" Aug 05 12:21:03.663038 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:03.662975 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57674bc75b-fzfx9" podUID="0196a164-0899-4a06-8c92-5b5f6e92f475" containerName="console" containerID="cri-o://fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb" gracePeriod=15 Aug 05 12:21:03.932467 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:03.932394 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:21:04.041186 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.041153 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-oauth-serving-cert\") pod \"0196a164-0899-4a06-8c92-5b5f6e92f475\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " Aug 05 12:21:04.041402 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.041226 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-console-config\") pod \"0196a164-0899-4a06-8c92-5b5f6e92f475\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " Aug 05 12:21:04.041402 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.041249 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-oauth-config\") pod \"0196a164-0899-4a06-8c92-5b5f6e92f475\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " Aug 05 12:21:04.041402 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.041275 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-service-ca\") pod \"0196a164-0899-4a06-8c92-5b5f6e92f475\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " Aug 05 12:21:04.041402 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.041292 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67xmb\" (UniqueName: \"kubernetes.io/projected/0196a164-0899-4a06-8c92-5b5f6e92f475-kube-api-access-67xmb\") pod \"0196a164-0899-4a06-8c92-5b5f6e92f475\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " Aug 05 12:21:04.041402 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.041371 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-serving-cert\") pod \"0196a164-0899-4a06-8c92-5b5f6e92f475\" (UID: \"0196a164-0899-4a06-8c92-5b5f6e92f475\") " Aug 05 12:21:04.041651 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.041597 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0196a164-0899-4a06-8c92-5b5f6e92f475" (UID: "0196a164-0899-4a06-8c92-5b5f6e92f475"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:04.041970 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.041942 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-service-ca" (OuterVolumeSpecName: "service-ca") pod "0196a164-0899-4a06-8c92-5b5f6e92f475" (UID: "0196a164-0899-4a06-8c92-5b5f6e92f475"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:04.042092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.042013 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-console-config" (OuterVolumeSpecName: "console-config") pod "0196a164-0899-4a06-8c92-5b5f6e92f475" (UID: "0196a164-0899-4a06-8c92-5b5f6e92f475"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:04.043886 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.043848 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0196a164-0899-4a06-8c92-5b5f6e92f475-kube-api-access-67xmb" (OuterVolumeSpecName: "kube-api-access-67xmb") pod "0196a164-0899-4a06-8c92-5b5f6e92f475" (UID: "0196a164-0899-4a06-8c92-5b5f6e92f475"). InnerVolumeSpecName "kube-api-access-67xmb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 12:21:04.043972 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.043888 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0196a164-0899-4a06-8c92-5b5f6e92f475" (UID: "0196a164-0899-4a06-8c92-5b5f6e92f475"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:04.043972 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.043923 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0196a164-0899-4a06-8c92-5b5f6e92f475" (UID: "0196a164-0899-4a06-8c92-5b5f6e92f475"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:04.142187 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.142149 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-serving-cert\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:04.142187 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.142179 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-oauth-serving-cert\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:04.142187 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.142191 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-console-config\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:04.142505 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.142204 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0196a164-0899-4a06-8c92-5b5f6e92f475-console-oauth-config\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:04.142505 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.142219 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0196a164-0899-4a06-8c92-5b5f6e92f475-service-ca\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:04.142505 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.142231 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67xmb\" (UniqueName: \"kubernetes.io/projected/0196a164-0899-4a06-8c92-5b5f6e92f475-kube-api-access-67xmb\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:04.753689 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.753653 2560 generic.go:356] "Generic (PLEG): container finished" podID="0196a164-0899-4a06-8c92-5b5f6e92f475" containerID="fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb" exitCode=0 Aug 05 12:21:04.754074 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.753708 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57674bc75b-fzfx9" Aug 05 12:21:04.754074 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.753716 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57674bc75b-fzfx9" event={"ID":"0196a164-0899-4a06-8c92-5b5f6e92f475","Type":"ContainerDied","Data":"fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb"} Aug 05 12:21:04.754074 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.753770 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57674bc75b-fzfx9" event={"ID":"0196a164-0899-4a06-8c92-5b5f6e92f475","Type":"ContainerDied","Data":"aced2924efbbf108f924157788490e17f76124faffeb69a5e1bb43c4684d0d23"} Aug 05 12:21:04.754074 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.753802 2560 scope.go:117] "RemoveContainer" containerID="fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb" Aug 05 12:21:04.762208 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.762185 2560 scope.go:117] "RemoveContainer" containerID="fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb" Aug 05 12:21:04.762461 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:21:04.762444 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb\": container with ID starting with fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb not found: ID does not exist" containerID="fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb" Aug 05 12:21:04.762517 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.762469 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb"} err="failed to get container status \"fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb\": rpc error: code = NotFound desc = could not find container \"fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb\": container with ID starting with fe1ecdb38ed2db1556516ec351ddbf9c8e90692405227051fbd8ce95357048fb not found: ID does not exist" Aug 05 12:21:04.774211 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.774193 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57674bc75b-fzfx9"] Aug 05 12:21:04.777686 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:04.777663 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57674bc75b-fzfx9"] Aug 05 12:21:05.034776 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:05.034700 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0196a164-0899-4a06-8c92-5b5f6e92f475" path="/var/lib/kubelet/pods/0196a164-0899-4a06-8c92-5b5f6e92f475/volumes" Aug 05 12:21:25.279636 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:25.279598 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:25.298629 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:25.298599 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:25.847945 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:25.847919 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:43.276831 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.276791 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:21:43.277238 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.277189 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="prometheus" containerID="cri-o://090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" gracePeriod=600 Aug 05 12:21:43.277331 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.277237 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" gracePeriod=600 Aug 05 12:21:43.277396 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.277291 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy" containerID="cri-o://3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" gracePeriod=600 Aug 05 12:21:43.277396 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.277328 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="config-reloader" containerID="cri-o://78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" gracePeriod=600 Aug 05 12:21:43.277396 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.277313 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy-web" containerID="cri-o://9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" gracePeriod=600 Aug 05 12:21:43.277538 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.277501 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="thanos-sidecar" containerID="cri-o://4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" gracePeriod=600 Aug 05 12:21:43.529015 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.528948 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:43.580918 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.580888 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-metrics-client-ca\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581088 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.580930 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-tls-assets\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581088 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.580957 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-0\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581088 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.580979 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-2\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581088 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581014 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config-out\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581088 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581051 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk8fc\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-kube-api-access-mk8fc\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581090 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-trusted-ca-bundle\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581126 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-db\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581154 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-tls\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581196 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-grpc-tls\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581223 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-kubelet-serving-ca-bundle\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581261 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-thanos-prometheus-http-client-file\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581317 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-kube-rbac-proxy\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581349 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-serving-certs-ca-bundle\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581353 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:43.581374 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581375 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-web-config\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581416 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-metrics-client-certs\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581444 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581473 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581520 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-1\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581532 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:43.581838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581548 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config\") pod \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\" (UID: \"9a530d4a-a752-41f6-bd39-0b95cce8bf6b\") " Aug 05 12:21:43.581838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581782 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-metrics-client-ca\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.581838 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.581798 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.582250 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.582180 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:43.584243 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.583720 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:43.584243 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.583732 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:43.584457 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.584275 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 12:21:43.584457 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.584370 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 12:21:43.584457 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.584433 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:43.584926 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.584760 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 12:21:43.584926 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.584843 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config" (OuterVolumeSpecName: "config") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.584926 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.584892 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config-out" (OuterVolumeSpecName: "config-out") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 12:21:43.586418 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.586385 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.587986 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.587947 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.588437 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.588408 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-kube-api-access-mk8fc" (OuterVolumeSpecName: "kube-api-access-mk8fc") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "kube-api-access-mk8fc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 12:21:43.590054 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.590012 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.590164 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.590105 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.590487 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.590375 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.590908 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.590876 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.591633 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.591601 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.599997 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.599972 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-web-config" (OuterVolumeSpecName: "web-config") pod "9a530d4a-a752-41f6-bd39-0b95cce8bf6b" (UID: "9a530d4a-a752-41f6-bd39-0b95cce8bf6b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 12:21:43.682594 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682561 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-db\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682594 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682590 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682607 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-grpc-tls\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682619 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682629 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682638 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-kube-rbac-proxy\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682646 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682654 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-web-config\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682662 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-metrics-client-certs\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682670 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682679 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682688 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682697 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682704 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-tls-assets\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682712 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682721 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-config-out\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682730 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk8fc\" (UniqueName: \"kubernetes.io/projected/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-kube-api-access-mk8fc\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.682783 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.682738 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a530d4a-a752-41f6-bd39-0b95cce8bf6b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-192.ec2.internal\" DevicePath \"\"" Aug 05 12:21:43.903986 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.903952 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" exitCode=0 Aug 05 12:21:43.903986 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.903978 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" exitCode=0 Aug 05 12:21:43.903986 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.903985 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" exitCode=0 Aug 05 12:21:43.903986 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.903991 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" exitCode=0 Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.903996 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" exitCode=0 Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904001 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" exitCode=0 Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904029 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904029 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerDied","Data":"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763"} Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904097 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerDied","Data":"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af"} Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerDied","Data":"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805"} Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904149 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerDied","Data":"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0"} Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904164 2560 scope.go:117] "RemoveContainer" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerDied","Data":"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0"} Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904201 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerDied","Data":"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296"} Aug 05 12:21:43.904252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.904225 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a530d4a-a752-41f6-bd39-0b95cce8bf6b","Type":"ContainerDied","Data":"af0d73cb1ed56d75435a1ade4a9577aa2643ce4f389f46406335d29acdfc7fb3"} Aug 05 12:21:43.911860 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.911840 2560 scope.go:117] "RemoveContainer" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" Aug 05 12:21:43.919170 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.919151 2560 scope.go:117] "RemoveContainer" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" Aug 05 12:21:43.925759 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.925741 2560 scope.go:117] "RemoveContainer" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" Aug 05 12:21:43.930819 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.930796 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:21:43.932826 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.932810 2560 scope.go:117] "RemoveContainer" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" Aug 05 12:21:43.935550 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.935529 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:21:43.940119 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.940098 2560 scope.go:117] "RemoveContainer" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" Aug 05 12:21:43.947191 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.947176 2560 scope.go:117] "RemoveContainer" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" Aug 05 12:21:43.954034 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.954018 2560 scope.go:117] "RemoveContainer" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" Aug 05 12:21:43.954294 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:21:43.954271 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": container with ID starting with 8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763 not found: ID does not exist" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" Aug 05 12:21:43.954389 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.954319 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763"} err="failed to get container status \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": rpc error: code = NotFound desc = could not find container \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": container with ID starting with 8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763 not found: ID does not exist" Aug 05 12:21:43.954389 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.954341 2560 scope.go:117] "RemoveContainer" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" Aug 05 12:21:43.954605 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:21:43.954566 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": container with ID starting with 3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af not found: ID does not exist" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" Aug 05 12:21:43.954643 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.954609 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af"} err="failed to get container status \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": rpc error: code = NotFound desc = could not find container \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": container with ID starting with 3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af not found: ID does not exist" Aug 05 12:21:43.954643 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.954623 2560 scope.go:117] "RemoveContainer" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" Aug 05 12:21:43.954867 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:21:43.954851 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": container with ID starting with 9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805 not found: ID does not exist" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" Aug 05 12:21:43.954905 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.954882 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805"} err="failed to get container status \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": rpc error: code = NotFound desc = could not find container \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": container with ID starting with 9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805 not found: ID does not exist" Aug 05 12:21:43.954905 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.954898 2560 scope.go:117] "RemoveContainer" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" Aug 05 12:21:43.955105 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:21:43.955085 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": container with ID starting with 4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0 not found: ID does not exist" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" Aug 05 12:21:43.955190 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.955109 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0"} err="failed to get container status \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": rpc error: code = NotFound desc = could not find container \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": container with ID starting with 4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0 not found: ID does not exist" Aug 05 12:21:43.955190 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.955126 2560 scope.go:117] "RemoveContainer" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" Aug 05 12:21:43.955332 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:21:43.955312 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": container with ID starting with 78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0 not found: ID does not exist" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" Aug 05 12:21:43.955393 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.955338 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0"} err="failed to get container status \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": rpc error: code = NotFound desc = could not find container \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": container with ID starting with 78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0 not found: ID does not exist" Aug 05 12:21:43.955393 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.955356 2560 scope.go:117] "RemoveContainer" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" Aug 05 12:21:43.955612 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:21:43.955594 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": container with ID starting with 090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296 not found: ID does not exist" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" Aug 05 12:21:43.955651 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.955616 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296"} err="failed to get container status \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": rpc error: code = NotFound desc = could not find container \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": container with ID starting with 090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296 not found: ID does not exist" Aug 05 12:21:43.955651 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.955630 2560 scope.go:117] "RemoveContainer" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" Aug 05 12:21:43.955853 ip-10-0-129-192 kubenswrapper[2560]: E0805 12:21:43.955838 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": container with ID starting with 22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6 not found: ID does not exist" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" Aug 05 12:21:43.955890 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.955857 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6"} err="failed to get container status \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": rpc error: code = NotFound desc = could not find container \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": container with ID starting with 22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6 not found: ID does not exist" Aug 05 12:21:43.955890 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.955873 2560 scope.go:117] "RemoveContainer" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" Aug 05 12:21:43.956051 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956035 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763"} err="failed to get container status \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": rpc error: code = NotFound desc = could not find container \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": container with ID starting with 8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763 not found: ID does not exist" Aug 05 12:21:43.956097 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956052 2560 scope.go:117] "RemoveContainer" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" Aug 05 12:21:43.956227 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956213 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af"} err="failed to get container status \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": rpc error: code = NotFound desc = could not find container \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": container with ID starting with 3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af not found: ID does not exist" Aug 05 12:21:43.956273 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956227 2560 scope.go:117] "RemoveContainer" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" Aug 05 12:21:43.956451 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956435 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805"} err="failed to get container status \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": rpc error: code = NotFound desc = could not find container \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": container with ID starting with 9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805 not found: ID does not exist" Aug 05 12:21:43.956451 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956449 2560 scope.go:117] "RemoveContainer" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" Aug 05 12:21:43.956631 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956617 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0"} err="failed to get container status \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": rpc error: code = NotFound desc = could not find container \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": container with ID starting with 4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0 not found: ID does not exist" Aug 05 12:21:43.956740 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956631 2560 scope.go:117] "RemoveContainer" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" Aug 05 12:21:43.956813 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956800 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0"} err="failed to get container status \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": rpc error: code = NotFound desc = could not find container \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": container with ID starting with 78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0 not found: ID does not exist" Aug 05 12:21:43.956850 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.956813 2560 scope.go:117] "RemoveContainer" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" Aug 05 12:21:43.957039 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957017 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296"} err="failed to get container status \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": rpc error: code = NotFound desc = could not find container \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": container with ID starting with 090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296 not found: ID does not exist" Aug 05 12:21:43.957093 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957040 2560 scope.go:117] "RemoveContainer" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" Aug 05 12:21:43.957252 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957238 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6"} err="failed to get container status \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": rpc error: code = NotFound desc = could not find container \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": container with ID starting with 22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6 not found: ID does not exist" Aug 05 12:21:43.957315 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957252 2560 scope.go:117] "RemoveContainer" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" Aug 05 12:21:43.957425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957409 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763"} err="failed to get container status \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": rpc error: code = NotFound desc = could not find container \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": container with ID starting with 8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763 not found: ID does not exist" Aug 05 12:21:43.957463 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957424 2560 scope.go:117] "RemoveContainer" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" Aug 05 12:21:43.957644 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957628 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af"} err="failed to get container status \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": rpc error: code = NotFound desc = could not find container \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": container with ID starting with 3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af not found: ID does not exist" Aug 05 12:21:43.957685 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957644 2560 scope.go:117] "RemoveContainer" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" Aug 05 12:21:43.957853 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957834 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805"} err="failed to get container status \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": rpc error: code = NotFound desc = could not find container \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": container with ID starting with 9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805 not found: ID does not exist" Aug 05 12:21:43.957897 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.957857 2560 scope.go:117] "RemoveContainer" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" Aug 05 12:21:43.958058 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958042 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0"} err="failed to get container status \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": rpc error: code = NotFound desc = could not find container \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": container with ID starting with 4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0 not found: ID does not exist" Aug 05 12:21:43.958098 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958058 2560 scope.go:117] "RemoveContainer" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" Aug 05 12:21:43.958237 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958222 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0"} err="failed to get container status \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": rpc error: code = NotFound desc = could not find container \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": container with ID starting with 78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0 not found: ID does not exist" Aug 05 12:21:43.958274 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958238 2560 scope.go:117] "RemoveContainer" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" Aug 05 12:21:43.958464 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958444 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296"} err="failed to get container status \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": rpc error: code = NotFound desc = could not find container \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": container with ID starting with 090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296 not found: ID does not exist" Aug 05 12:21:43.958523 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958465 2560 scope.go:117] "RemoveContainer" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" Aug 05 12:21:43.958694 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958677 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6"} err="failed to get container status \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": rpc error: code = NotFound desc = could not find container \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": container with ID starting with 22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6 not found: ID does not exist" Aug 05 12:21:43.958734 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958693 2560 scope.go:117] "RemoveContainer" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" Aug 05 12:21:43.958894 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958875 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763"} err="failed to get container status \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": rpc error: code = NotFound desc = could not find container \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": container with ID starting with 8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763 not found: ID does not exist" Aug 05 12:21:43.958959 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.958896 2560 scope.go:117] "RemoveContainer" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" Aug 05 12:21:43.959321 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.959205 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af"} err="failed to get container status \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": rpc error: code = NotFound desc = could not find container \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": container with ID starting with 3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af not found: ID does not exist" Aug 05 12:21:43.959321 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.959231 2560 scope.go:117] "RemoveContainer" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" Aug 05 12:21:43.959561 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.959500 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805"} err="failed to get container status \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": rpc error: code = NotFound desc = could not find container \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": container with ID starting with 9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805 not found: ID does not exist" Aug 05 12:21:43.959561 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.959526 2560 scope.go:117] "RemoveContainer" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" Aug 05 12:21:43.960115 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.960091 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0"} err="failed to get container status \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": rpc error: code = NotFound desc = could not find container \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": container with ID starting with 4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0 not found: ID does not exist" Aug 05 12:21:43.960115 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.960111 2560 scope.go:117] "RemoveContainer" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" Aug 05 12:21:43.960425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.960406 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0"} err="failed to get container status \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": rpc error: code = NotFound desc = could not find container \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": container with ID starting with 78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0 not found: ID does not exist" Aug 05 12:21:43.960425 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.960424 2560 scope.go:117] "RemoveContainer" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" Aug 05 12:21:43.960659 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.960641 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296"} err="failed to get container status \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": rpc error: code = NotFound desc = could not find container \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": container with ID starting with 090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296 not found: ID does not exist" Aug 05 12:21:43.960709 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.960660 2560 scope.go:117] "RemoveContainer" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" Aug 05 12:21:43.960883 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.960863 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6"} err="failed to get container status \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": rpc error: code = NotFound desc = could not find container \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": container with ID starting with 22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6 not found: ID does not exist" Aug 05 12:21:43.960883 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.960882 2560 scope.go:117] "RemoveContainer" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" Aug 05 12:21:43.961119 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961103 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763"} err="failed to get container status \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": rpc error: code = NotFound desc = could not find container \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": container with ID starting with 8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763 not found: ID does not exist" Aug 05 12:21:43.961170 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961119 2560 scope.go:117] "RemoveContainer" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" Aug 05 12:21:43.961170 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961138 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:21:43.961361 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961343 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af"} err="failed to get container status \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": rpc error: code = NotFound desc = could not find container \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": container with ID starting with 3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af not found: ID does not exist" Aug 05 12:21:43.961426 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961362 2560 scope.go:117] "RemoveContainer" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" Aug 05 12:21:43.961426 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961406 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0196a164-0899-4a06-8c92-5b5f6e92f475" containerName="console" Aug 05 12:21:43.961426 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961417 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0196a164-0899-4a06-8c92-5b5f6e92f475" containerName="console" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961433 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="thanos-sidecar" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961439 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="thanos-sidecar" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961446 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961452 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961458 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy-thanos" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961464 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy-thanos" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961477 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="prometheus" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961482 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="prometheus" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961487 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy-web" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961492 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy-web" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961500 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="init-config-reloader" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961505 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="init-config-reloader" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961511 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="config-reloader" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961516 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="config-reloader" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961566 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy-thanos" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961578 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0196a164-0899-4a06-8c92-5b5f6e92f475" containerName="console" Aug 05 12:21:43.961576 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961586 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="config-reloader" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961593 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy-web" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961605 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="prometheus" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961614 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="thanos-sidecar" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961613 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805"} err="failed to get container status \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": rpc error: code = NotFound desc = could not find container \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": container with ID starting with 9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805 not found: ID does not exist" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961632 2560 scope.go:117] "RemoveContainer" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961620 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" containerName="kube-rbac-proxy" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961845 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0"} err="failed to get container status \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": rpc error: code = NotFound desc = could not find container \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": container with ID starting with 4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0 not found: ID does not exist" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.961869 2560 scope.go:117] "RemoveContainer" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.962090 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0"} err="failed to get container status \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": rpc error: code = NotFound desc = could not find container \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": container with ID starting with 78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0 not found: ID does not exist" Aug 05 12:21:43.962165 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.962110 2560 scope.go:117] "RemoveContainer" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" Aug 05 12:21:43.962542 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.962315 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296"} err="failed to get container status \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": rpc error: code = NotFound desc = could not find container \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": container with ID starting with 090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296 not found: ID does not exist" Aug 05 12:21:43.962542 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.962337 2560 scope.go:117] "RemoveContainer" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" Aug 05 12:21:43.962623 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.962568 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6"} err="failed to get container status \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": rpc error: code = NotFound desc = could not find container \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": container with ID starting with 22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6 not found: ID does not exist" Aug 05 12:21:43.962623 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.962587 2560 scope.go:117] "RemoveContainer" containerID="8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763" Aug 05 12:21:43.962840 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.962823 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763"} err="failed to get container status \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": rpc error: code = NotFound desc = could not find container \"8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763\": container with ID starting with 8b2b0f0d3f996d69c2eaefaa48dff1141bdb02e39e3fb085730ab13355bcf763 not found: ID does not exist" Aug 05 12:21:43.962893 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.962841 2560 scope.go:117] "RemoveContainer" containerID="3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af" Aug 05 12:21:43.963035 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.963019 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af"} err="failed to get container status \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": rpc error: code = NotFound desc = could not find container \"3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af\": container with ID starting with 3afbc2ea50046a1878237627e179630e1944ee70797067b902c198b7557988af not found: ID does not exist" Aug 05 12:21:43.963086 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.963042 2560 scope.go:117] "RemoveContainer" containerID="9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805" Aug 05 12:21:43.963248 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.963229 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805"} err="failed to get container status \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": rpc error: code = NotFound desc = could not find container \"9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805\": container with ID starting with 9b144eb0fc774ded6830b9ff05b7b4f54adb4988020fc95d6677e5cccdb0c805 not found: ID does not exist" Aug 05 12:21:43.963248 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.963247 2560 scope.go:117] "RemoveContainer" containerID="4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0" Aug 05 12:21:43.963540 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.963516 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0"} err="failed to get container status \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": rpc error: code = NotFound desc = could not find container \"4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0\": container with ID starting with 4007b5d70df02e9335de302b7cbdef83f9828636ac9e96a5b251f3aa55984ca0 not found: ID does not exist" Aug 05 12:21:43.963640 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.963541 2560 scope.go:117] "RemoveContainer" containerID="78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0" Aug 05 12:21:43.963848 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.963815 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0"} err="failed to get container status \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": rpc error: code = NotFound desc = could not find container \"78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0\": container with ID starting with 78bf2d6488556071cfa5a0736dae1b6722a814ac3260f3447ca30a1d561106f0 not found: ID does not exist" Aug 05 12:21:43.963931 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.963848 2560 scope.go:117] "RemoveContainer" containerID="090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296" Aug 05 12:21:43.964185 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.964113 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296"} err="failed to get container status \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": rpc error: code = NotFound desc = could not find container \"090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296\": container with ID starting with 090075de77ea83af40becc99d18afbcca3a7f7468b18c3356de83e226c329296 not found: ID does not exist" Aug 05 12:21:43.964185 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.964137 2560 scope.go:117] "RemoveContainer" containerID="22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6" Aug 05 12:21:43.964462 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.964436 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6"} err="failed to get container status \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": rpc error: code = NotFound desc = could not find container \"22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6\": container with ID starting with 22434a8ac2e8879f8702016100da7c26e24654e38ea3846e18e929b9825d58d6 not found: ID does not exist" Aug 05 12:21:43.965988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.965971 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:43.968338 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968320 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 05 12:21:43.968547 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968324 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 05 12:21:43.968547 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968324 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 05 12:21:43.968706 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968343 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 05 12:21:43.968823 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968805 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ckb5doh74t07g\"" Aug 05 12:21:43.968823 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968817 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 05 12:21:43.968972 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968818 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 05 12:21:43.968972 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968812 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 05 12:21:43.968972 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.968898 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 05 12:21:43.969122 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.969031 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 05 12:21:43.969175 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.969135 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sq86k\"" Aug 05 12:21:43.969175 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.969155 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 05 12:21:43.969272 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.969158 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 05 12:21:43.969272 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.969141 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 05 12:21:43.969272 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.969195 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 05 12:21:43.972479 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.972459 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 05 12:21:43.976904 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.976866 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 05 12:21:43.981350 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:43.981329 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:21:44.085151 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085109 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085151 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085151 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085419 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085419 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085252 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085419 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75e4b6c-1491-4ab7-ae83-10a150dc166c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085419 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085346 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085419 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085364 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085595 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085455 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085630 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085630 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085614 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085700 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085700 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75e4b6c-1491-4ab7-ae83-10a150dc166c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085770 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085702 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085770 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085770 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-config\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085868 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085868 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085807 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085868 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085868 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpwp\" (UniqueName: \"kubernetes.io/projected/f75e4b6c-1491-4ab7-ae83-10a150dc166c-kube-api-access-2hpwp\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.085868 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.085862 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186622 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186622 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186622 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186781 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186633 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186781 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75e4b6c-1491-4ab7-ae83-10a150dc166c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186781 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186781 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186799 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-config\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186853 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.186962 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186937 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpwp\" (UniqueName: \"kubernetes.io/projected/f75e4b6c-1491-4ab7-ae83-10a150dc166c-kube-api-access-2hpwp\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.186971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187005 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187034 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187061 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187097 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75e4b6c-1491-4ab7-ae83-10a150dc166c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187199 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187356 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187626 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187477 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.187998 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.187970 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.189378 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.189348 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.189745 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.189573 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75e4b6c-1491-4ab7-ae83-10a150dc166c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.189745 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.189644 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.190448 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.189921 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.190448 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.189930 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.190448 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.190042 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.190448 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.190112 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.190448 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.190342 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.191275 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.190993 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.191275 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.191191 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.191612 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.191590 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.191817 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.191800 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f75e4b6c-1491-4ab7-ae83-10a150dc166c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.191887 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.191842 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-config\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.192511 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.192483 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.192601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.192553 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75e4b6c-1491-4ab7-ae83-10a150dc166c-web-config\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.192601 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.192592 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75e4b6c-1491-4ab7-ae83-10a150dc166c-config-out\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.198196 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.198181 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpwp\" (UniqueName: \"kubernetes.io/projected/f75e4b6c-1491-4ab7-ae83-10a150dc166c-kube-api-access-2hpwp\") pod \"prometheus-k8s-0\" (UID: \"f75e4b6c-1491-4ab7-ae83-10a150dc166c\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.277435 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.277410 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:21:44.427000 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.426958 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 12:21:44.430377 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:21:44.430347 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf75e4b6c_1491_4ab7_ae83_10a150dc166c.slice/crio-f0dde78c37de0d06702bf66adeacfd7b0a41e2b4f3ba4b07e22a5950b91ebe78 WatchSource:0}: Error finding container f0dde78c37de0d06702bf66adeacfd7b0a41e2b4f3ba4b07e22a5950b91ebe78: Status 404 returned error can't find the container with id f0dde78c37de0d06702bf66adeacfd7b0a41e2b4f3ba4b07e22a5950b91ebe78 Aug 05 12:21:44.910175 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.910140 2560 generic.go:356] "Generic (PLEG): container finished" podID="f75e4b6c-1491-4ab7-ae83-10a150dc166c" containerID="c38007742c39abf08a43a9dfcd5a78919f0de113a7806845953b13ff097967aa" exitCode=0 Aug 05 12:21:44.910346 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.910226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75e4b6c-1491-4ab7-ae83-10a150dc166c","Type":"ContainerDied","Data":"c38007742c39abf08a43a9dfcd5a78919f0de113a7806845953b13ff097967aa"} Aug 05 12:21:44.910346 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:44.910292 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75e4b6c-1491-4ab7-ae83-10a150dc166c","Type":"ContainerStarted","Data":"f0dde78c37de0d06702bf66adeacfd7b0a41e2b4f3ba4b07e22a5950b91ebe78"} Aug 05 12:21:45.036475 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:45.036447 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a530d4a-a752-41f6-bd39-0b95cce8bf6b" path="/var/lib/kubelet/pods/9a530d4a-a752-41f6-bd39-0b95cce8bf6b/volumes" Aug 05 12:21:45.918126 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:45.918092 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75e4b6c-1491-4ab7-ae83-10a150dc166c","Type":"ContainerStarted","Data":"4a261fdaf9a5dff1a5a6731882e8d7094869eff383f737bdaec471ee53c30011"} Aug 05 12:21:45.918610 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:45.918152 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75e4b6c-1491-4ab7-ae83-10a150dc166c","Type":"ContainerStarted","Data":"fd17b657ba4fd6669bfa0ecca1050bcb1abdcb1a83b8a429db8449758d2b7e30"} Aug 05 12:21:45.918610 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:45.918178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75e4b6c-1491-4ab7-ae83-10a150dc166c","Type":"ContainerStarted","Data":"203063a3e64138407768e7914f69ec7bc9d202b9ea22fc86c7408f98ed7ab167"} Aug 05 12:21:45.918610 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:45.918203 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75e4b6c-1491-4ab7-ae83-10a150dc166c","Type":"ContainerStarted","Data":"544df16462346bfca8ab102a097c061ecd9d423bb388733d368a409819346248"} Aug 05 12:21:45.918610 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:45.918228 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75e4b6c-1491-4ab7-ae83-10a150dc166c","Type":"ContainerStarted","Data":"11865a6712a60e386f74c572747a9aca36144c598b920458b0f7de6010e444db"} Aug 05 12:21:45.918610 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:45.918250 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75e4b6c-1491-4ab7-ae83-10a150dc166c","Type":"ContainerStarted","Data":"185aef1dcafbb2eb426abe1b411b20529e5c0e321b06c2c99e53d8793fbc6f9e"} Aug 05 12:21:45.948599 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:45.948551 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9318837479999997 podStartE2EDuration="2.948533561s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.649813ms" isStatefulPod=false podCreationTimestamp="2026-08-05 12:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:21:45.946482545 +0000 UTC m=+169.457153612" watchObservedRunningTime="2026-08-05 12:21:45.948533561 +0000 UTC m=+169.459204675" Aug 05 12:21:49.278120 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:21:49.278043 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:22:44.277890 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:22:44.277852 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:22:44.293064 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:22:44.293038 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:22:45.153801 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:22:45.153773 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 12:23:56.861285 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:23:56.861254 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:23:56.871184 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:23:56.871098 2560 kubelet.go:1648] "Image garbage collection succeeded" Aug 05 12:23:56.876596 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:23:56.876572 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:28:56.890140 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:28:56.890113 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:28:56.898611 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:28:56.898589 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:33:56.914092 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:33:56.914017 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:33:56.926785 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:33:56.926765 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:38:56.943602 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:38:56.943574 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:38:56.949372 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:38:56.949350 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:43:56.967314 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:43:56.967277 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:43:56.971181 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:43:56.971150 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:48:56.992188 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:48:56.992155 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:48:56.992919 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:48:56.992903 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:49:50.274665 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:50.274638 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kqsfn_72a568d6-8cc6-4dd4-9c93-2c1393198783/global-pull-secret-syncer/0.log" Aug 05 12:49:50.399432 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:50.399406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4kmm4_d2112b6a-081c-4700-8789-2e82809fdbba/konnectivity-agent/0.log" Aug 05 12:49:50.450929 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:50.450897 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-192.ec2.internal_645b936c36ac9f10f261c827f21930d7/haproxy/0.log" Aug 05 12:49:54.623642 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.623566 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzvrm_04062a1d-d106-4f55-9209-7dce86e19878/node-exporter/0.log" Aug 05 12:49:54.642520 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.642498 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzvrm_04062a1d-d106-4f55-9209-7dce86e19878/kube-rbac-proxy/0.log" Aug 05 12:49:54.664294 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.664270 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzvrm_04062a1d-d106-4f55-9209-7dce86e19878/init-textfile/0.log" Aug 05 12:49:54.695558 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.695525 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7h4sg_5e802fd6-de14-4714-a1bc-8bde5740c18d/kube-rbac-proxy-main/0.log" Aug 05 12:49:54.715064 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.715048 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7h4sg_5e802fd6-de14-4714-a1bc-8bde5740c18d/kube-rbac-proxy-self/0.log" Aug 05 12:49:54.744428 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.744408 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7h4sg_5e802fd6-de14-4714-a1bc-8bde5740c18d/openshift-state-metrics/0.log" Aug 05 12:49:54.807605 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.807577 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75e4b6c-1491-4ab7-ae83-10a150dc166c/prometheus/0.log" Aug 05 12:49:54.826773 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.826733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75e4b6c-1491-4ab7-ae83-10a150dc166c/config-reloader/0.log" Aug 05 12:49:54.849805 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.849782 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75e4b6c-1491-4ab7-ae83-10a150dc166c/thanos-sidecar/0.log" Aug 05 12:49:54.870193 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.870167 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75e4b6c-1491-4ab7-ae83-10a150dc166c/kube-rbac-proxy-web/0.log" Aug 05 12:49:54.890694 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.890672 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75e4b6c-1491-4ab7-ae83-10a150dc166c/kube-rbac-proxy/0.log" Aug 05 12:49:54.911220 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.911191 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75e4b6c-1491-4ab7-ae83-10a150dc166c/kube-rbac-proxy-thanos/0.log" Aug 05 12:49:54.931341 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.931322 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75e4b6c-1491-4ab7-ae83-10a150dc166c/init-config-reloader/0.log" Aug 05 12:49:54.956803 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.956779 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-4x9qv_697d01d0-2052-4bcc-813c-9838f8caa26a/prometheus-operator/0.log" Aug 05 12:49:54.976256 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:54.976240 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-4x9qv_697d01d0-2052-4bcc-813c-9838f8caa26a/kube-rbac-proxy/0.log" Aug 05 12:49:55.002988 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:55.002957 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-sx84j_1f93501b-9432-459e-85c7-892adfbbb59b/prometheus-operator-admission-webhook/0.log" Aug 05 12:49:55.119253 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:55.119208 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74cd8457b9-clvqj_495f709d-df39-4490-bd9a-364ece8ba6c1/thanos-query/0.log" Aug 05 12:49:55.142823 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:55.142712 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74cd8457b9-clvqj_495f709d-df39-4490-bd9a-364ece8ba6c1/kube-rbac-proxy-web/0.log" Aug 05 12:49:55.164485 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:55.164462 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74cd8457b9-clvqj_495f709d-df39-4490-bd9a-364ece8ba6c1/kube-rbac-proxy/0.log" Aug 05 12:49:55.184781 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:55.184759 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74cd8457b9-clvqj_495f709d-df39-4490-bd9a-364ece8ba6c1/prom-label-proxy/0.log" Aug 05 12:49:55.205133 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:55.205108 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74cd8457b9-clvqj_495f709d-df39-4490-bd9a-364ece8ba6c1/kube-rbac-proxy-rules/0.log" Aug 05 12:49:55.227325 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:55.227287 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-74cd8457b9-clvqj_495f709d-df39-4490-bd9a-364ece8ba6c1/kube-rbac-proxy-metrics/0.log" Aug 05 12:49:57.304373 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:57.304340 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-n4c2n_15a98b75-f59e-4c96-b0d1-53153d4414a0/download-server/0.log" Aug 05 12:49:58.111732 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.111698 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd"] Aug 05 12:49:58.115097 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.115073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.117077 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.117055 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qsg45\"/\"default-dockercfg-skb8c\"" Aug 05 12:49:58.118076 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.118062 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qsg45\"/\"kube-root-ca.crt\"" Aug 05 12:49:58.118154 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.118081 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qsg45\"/\"openshift-service-ca.crt\"" Aug 05 12:49:58.124337 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.124316 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd"] Aug 05 12:49:58.137631 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.137611 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-podres\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.137737 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.137673 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-lib-modules\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.137737 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.137692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-proc\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.137737 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.137717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-sys\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.137845 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.137799 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzmvf\" (UniqueName: \"kubernetes.io/projected/60a18d3c-b5e7-4412-8eae-8743c6904309-kube-api-access-pzmvf\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239057 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-podres\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239057 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-lib-modules\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239255 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-proc\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239255 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239149 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-proc\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239255 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239188 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-sys\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239255 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239197 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-podres\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239255 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzmvf\" (UniqueName: \"kubernetes.io/projected/60a18d3c-b5e7-4412-8eae-8743c6904309-kube-api-access-pzmvf\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239255 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239225 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-lib-modules\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.239486 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.239247 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60a18d3c-b5e7-4412-8eae-8743c6904309-sys\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.246664 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.246633 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzmvf\" (UniqueName: \"kubernetes.io/projected/60a18d3c-b5e7-4412-8eae-8743c6904309-kube-api-access-pzmvf\") pod \"perf-node-gather-daemonset-98vdd\" (UID: \"60a18d3c-b5e7-4412-8eae-8743c6904309\") " pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.424905 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.424875 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:58.551485 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.551463 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd"] Aug 05 12:49:58.553940 ip-10-0-129-192 kubenswrapper[2560]: W0805 12:49:58.553907 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod60a18d3c_b5e7_4412_8eae_8743c6904309.slice/crio-fad871739ca3feb794e066f1cadef8be77a8389e45f134abf90c6caccaac5097 WatchSource:0}: Error finding container fad871739ca3feb794e066f1cadef8be77a8389e45f134abf90c6caccaac5097: Status 404 returned error can't find the container with id fad871739ca3feb794e066f1cadef8be77a8389e45f134abf90c6caccaac5097 Aug 05 12:49:58.577250 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.577215 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s27hp_aa9b57fb-914f-4754-9167-137c1d12b79c/dns/0.log" Aug 05 12:49:58.598687 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.598665 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s27hp_aa9b57fb-914f-4754-9167-137c1d12b79c/kube-rbac-proxy/0.log" Aug 05 12:49:58.667572 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:58.667552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-glb5w_0474997c-86af-453b-8957-5e3360208078/dns-node-resolver/0.log" Aug 05 12:49:59.089593 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:59.089562 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5749d664f8-6brsx_0a2a686b-0758-4afc-a1b8-c2074bd13187/registry/0.log" Aug 05 12:49:59.107929 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:59.107905 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-npm29_d4bee1f1-ab53-433b-a7d5-8bda5f0d32c4/node-ca/0.log" Aug 05 12:49:59.140488 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:59.140451 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" event={"ID":"60a18d3c-b5e7-4412-8eae-8743c6904309","Type":"ContainerStarted","Data":"9e3b0bf04215580feeb643a36b77102c801c4cf6600e2baacba8d14b5e89003d"} Aug 05 12:49:59.140674 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:59.140510 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" event={"ID":"60a18d3c-b5e7-4412-8eae-8743c6904309","Type":"ContainerStarted","Data":"fad871739ca3feb794e066f1cadef8be77a8389e45f134abf90c6caccaac5097"} Aug 05 12:49:59.140674 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:59.140593 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:49:59.158095 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:49:59.158038 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" podStartSLOduration=1.158020615 podStartE2EDuration="1.158020615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 12:49:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 12:49:59.156762356 +0000 UTC m=+1862.667433423" watchObservedRunningTime="2026-08-05 12:49:59.158020615 +0000 UTC m=+1862.668691685" Aug 05 12:50:00.153784 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:00.153756 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jpnjw_dbe02a6d-47a2-419f-bc5f-803a6a8ce98e/serve-healthcheck-canary/0.log" Aug 05 12:50:00.536558 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:00.536476 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-blm6p_dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3/kube-rbac-proxy/0.log" Aug 05 12:50:00.555513 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:00.555486 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-blm6p_dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3/exporter/0.log" Aug 05 12:50:00.574731 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:00.574705 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-blm6p_dc36b7af-e928-464e-8cbc-e7bf3b3ee2b3/extractor/0.log" Aug 05 12:50:05.153032 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:05.152999 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qsg45/perf-node-gather-daemonset-98vdd" Aug 05 12:50:05.755198 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:05.755170 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xcvz_35449318-618e-4493-a22f-388310f5cbae/kube-multus-additional-cni-plugins/0.log" Aug 05 12:50:05.773843 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:05.773814 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xcvz_35449318-618e-4493-a22f-388310f5cbae/egress-router-binary-copy/0.log" Aug 05 12:50:05.792213 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:05.792190 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xcvz_35449318-618e-4493-a22f-388310f5cbae/cni-plugins/0.log" Aug 05 12:50:05.809239 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:05.809219 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xcvz_35449318-618e-4493-a22f-388310f5cbae/bond-cni-plugin/0.log" Aug 05 12:50:05.826652 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:05.826625 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xcvz_35449318-618e-4493-a22f-388310f5cbae/routeoverride-cni/0.log" Aug 05 12:50:05.843874 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:05.843849 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xcvz_35449318-618e-4493-a22f-388310f5cbae/whereabouts-cni-bincopy/0.log" Aug 05 12:50:05.861209 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:05.861190 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2xcvz_35449318-618e-4493-a22f-388310f5cbae/whereabouts-cni/0.log" Aug 05 12:50:06.207682 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:06.207651 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qpgrc_efe6a4fa-c797-48ac-bf89-c201f50c6a82/kube-multus/0.log" Aug 05 12:50:06.343995 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:06.343967 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wcxrc_dfd0ac47-bc49-46f0-8848-b17a54c9df3a/network-metrics-daemon/0.log" Aug 05 12:50:06.361438 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:06.361411 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wcxrc_dfd0ac47-bc49-46f0-8848-b17a54c9df3a/kube-rbac-proxy/0.log" Aug 05 12:50:07.584445 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.584419 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-controller/0.log" Aug 05 12:50:07.599915 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.599890 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/1.log" Aug 05 12:50:07.600169 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.600150 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovn-acl-logging/0.log" Aug 05 12:50:07.620648 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.620627 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/kube-rbac-proxy-node/0.log" Aug 05 12:50:07.640563 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.640540 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/kube-rbac-proxy-ovn-metrics/0.log" Aug 05 12:50:07.661656 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.661640 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/northd/0.log" Aug 05 12:50:07.682636 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.682614 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/nbdb/0.log" Aug 05 12:50:07.704376 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.704314 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/sbdb/0.log" Aug 05 12:50:07.752276 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:07.752251 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q8nkk_d4c83e3a-d7c3-4e67-b81e-bc7af7235da4/ovnkube-controller/0.log" Aug 05 12:50:08.660589 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:08.660564 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6m4tz_636d0bb5-96fa-410a-b1c1-c613d11e9a29/network-check-target-container/0.log" Aug 05 12:50:09.602755 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:09.602724 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-fvs7p_86160c72-c49f-4eb5-9484-6f764aeae43b/iptables-alerter/0.log" Aug 05 12:50:10.190030 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:10.190000 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hftm8_6970973f-db5b-4900-8ffa-632c76887ba3/tuned/0.log" Aug 05 12:50:13.043389 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:13.043356 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-98c88fbb5-z86cb_e637b73a-3d7d-493d-a76b-5a683c1c1a78/service-ca-controller/0.log" Aug 05 12:50:13.385716 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:13.385634 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j9l52_39b10769-8554-4e57-974f-b625bfa322cf/csi-driver/0.log" Aug 05 12:50:13.402860 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:13.402829 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j9l52_39b10769-8554-4e57-974f-b625bfa322cf/csi-node-driver-registrar/0.log" Aug 05 12:50:13.420604 ip-10-0-129-192 kubenswrapper[2560]: I0805 12:50:13.420575 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-j9l52_39b10769-8554-4e57-974f-b625bfa322cf/csi-liveness-probe/0.log"