Sep 06 02:51:25.046066 ip-10-0-141-131 systemd[1]: Starting Kubernetes Kubelet... Sep 06 02:51:25.480711 ip-10-0-141-131 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 06 02:51:25.480711 ip-10-0-141-131 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 06 02:51:25.480711 ip-10-0-141-131 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 06 02:51:25.480711 ip-10-0-141-131 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 06 02:51:25.480711 ip-10-0-141-131 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 06 02:51:25.481697 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.481625 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 06 02:51:25.487457 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487441 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 02:51:25.487457 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487457 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487460 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487464 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487469 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487473 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487485 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487489 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487491 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487494 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487497 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487500 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487502 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487505 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487508 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487511 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487513 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487516 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487518 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487521 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 02:51:25.487522 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487524 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487526 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487529 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487532 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487535 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487538 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487540 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487543 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487545 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487547 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487550 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487552 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487555 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487557 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487560 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487562 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487566 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487568 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487571 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 02:51:25.488009 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487573 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487577 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487581 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487583 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487586 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487589 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487591 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487594 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487596 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487599 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487602 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487604 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487607 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487609 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487612 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487615 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487618 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487621 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487623 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487627 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 02:51:25.488462 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487630 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487633 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487635 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487638 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487641 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487644 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487647 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487649 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487652 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487654 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487657 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487660 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487664 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487666 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487669 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487671 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487674 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487676 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487679 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487681 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 06 02:51:25.488979 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487685 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487689 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487692 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487695 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487697 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487700 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487702 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487706 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487709 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487712 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487714 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487717 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487719 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487722 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487724 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487727 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487730 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487732 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487735 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.487737 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 02:51:25.489699 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488426 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488433 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488436 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488439 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488442 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488445 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488448 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488451 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488454 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488457 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488460 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488462 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488465 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488467 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488470 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488473 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488475 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488478 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488482 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488485 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 02:51:25.490207 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488488 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488490 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488493 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488496 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488498 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488501 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488503 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488506 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488508 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488511 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488513 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488516 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488518 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488521 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488524 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488526 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488529 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488531 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488534 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488537 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 02:51:25.490708 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488540 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488542 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488545 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488547 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488550 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488553 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488556 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488559 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488563 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488566 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488569 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488571 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488574 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488576 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488579 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488582 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488585 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488587 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488589 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488592 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 02:51:25.491351 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488594 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488597 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488599 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488602 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488605 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488607 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488611 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488614 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488617 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488620 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488622 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488625 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488627 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488630 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488633 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488652 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488655 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488657 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488660 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 02:51:25.491889 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488663 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488666 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488668 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488671 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488674 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488678 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488681 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488684 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488687 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488690 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488693 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488696 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488699 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488701 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488704 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488707 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488710 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488712 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488715 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.488718 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 02:51:25.492432 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491665 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491674 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491678 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491681 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491684 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491687 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491690 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491693 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491695 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491698 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491700 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491703 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491707 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491709 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491712 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491715 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491718 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491721 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491724 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491726 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 02:51:25.492934 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491729 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491731 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491734 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491736 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491739 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491741 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491744 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491747 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491750 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491752 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491754 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491757 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491760 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491762 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491765 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491767 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491786 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491789 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491792 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491795 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 02:51:25.493444 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491797 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491800 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491803 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491806 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491808 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491811 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491813 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491816 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491818 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491821 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491824 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491827 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491830 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491832 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491835 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491838 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491840 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491843 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491845 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 02:51:25.493945 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491848 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491850 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491853 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491855 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491858 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491861 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491863 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491866 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491869 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491872 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491874 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491877 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491880 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491883 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491885 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491888 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491890 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491893 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491896 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491899 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 02:51:25.494440 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491902 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491905 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491908 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491912 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491919 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491922 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491926 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491929 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491932 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491935 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491938 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491941 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491944 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491947 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491951 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491954 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491956 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491959 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491962 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 02:51:25.494949 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.491964 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492036 2569 flags.go:64] FLAG: --address="0.0.0.0" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492069 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492076 2569 flags.go:64] FLAG: --anonymous-auth="true" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492080 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492085 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492088 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492093 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492097 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492100 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492103 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492107 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492110 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492114 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492117 2569 flags.go:64] FLAG: --cgroup-root="" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492119 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492123 2569 flags.go:64] FLAG: --client-ca-file="" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492125 2569 flags.go:64] FLAG: --cloud-provider="external" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492129 2569 flags.go:64] FLAG: --cluster-dns="[]" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492133 2569 flags.go:64] FLAG: --cluster-domain="" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492136 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492139 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492142 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492145 2569 flags.go:64] FLAG: --container-log-max-files="5" Sep 06 02:51:25.495418 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492149 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492152 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492155 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492158 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492161 2569 flags.go:64] FLAG: --contention-profiling="false" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492164 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492167 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492170 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492173 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492177 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492180 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492183 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492186 2569 flags.go:64] FLAG: --enable-load-reader="false" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492189 2569 flags.go:64] FLAG: --enable-server="true" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492192 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492197 2569 flags.go:64] FLAG: --event-burst="100" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492201 2569 flags.go:64] FLAG: --event-qps="50" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492203 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492206 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492209 2569 flags.go:64] FLAG: --eviction-hard="" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492213 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492216 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492219 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492221 2569 flags.go:64] FLAG: --eviction-soft="" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492224 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 06 02:51:25.496058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492227 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492230 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492234 2569 flags.go:64] FLAG: --experimental-mounter-path="" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492237 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492240 2569 flags.go:64] FLAG: --fail-swap-on="true" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492243 2569 flags.go:64] FLAG: --feature-gates="" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492247 2569 flags.go:64] FLAG: --file-check-frequency="20s" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492250 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492253 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492256 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492259 2569 flags.go:64] FLAG: --healthz-port="10248" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492262 2569 flags.go:64] FLAG: --help="false" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492265 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492268 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492270 2569 flags.go:64] FLAG: --http-check-frequency="20s" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492273 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492276 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492280 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492283 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492285 2569 flags.go:64] FLAG: --image-service-endpoint="" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492288 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492291 2569 flags.go:64] FLAG: --kube-api-burst="100" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492294 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492297 2569 flags.go:64] FLAG: --kube-api-qps="50" Sep 06 02:51:25.496662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492299 2569 flags.go:64] FLAG: --kube-reserved="" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492302 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492305 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492311 2569 flags.go:64] FLAG: --kubelet-cgroups="" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492314 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492317 2569 flags.go:64] FLAG: --lock-file="" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492319 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492322 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492325 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492330 2569 flags.go:64] FLAG: --log-json-split-stream="false" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492333 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492336 2569 flags.go:64] FLAG: --log-text-split-stream="false" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492339 2569 flags.go:64] FLAG: --logging-format="text" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492342 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492346 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492349 2569 flags.go:64] FLAG: --manifest-url="" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492352 2569 flags.go:64] FLAG: --manifest-url-header="" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492356 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492359 2569 flags.go:64] FLAG: --max-open-files="1000000" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492365 2569 flags.go:64] FLAG: --max-pods="110" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492368 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492371 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492374 2569 flags.go:64] FLAG: --memory-manager-policy="None" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492377 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492380 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 06 02:51:25.497269 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492383 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492386 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492393 2569 flags.go:64] FLAG: --node-status-max-images="50" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492395 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492398 2569 flags.go:64] FLAG: --oom-score-adj="-999" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492401 2569 flags.go:64] FLAG: --pod-cidr="" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492404 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492409 2569 flags.go:64] FLAG: --pod-manifest-path="" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492412 2569 flags.go:64] FLAG: --pod-max-pids="-1" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492415 2569 flags.go:64] FLAG: --pods-per-core="0" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492421 2569 flags.go:64] FLAG: --port="10250" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492424 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492427 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa41355315f0e7a6" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492430 2569 flags.go:64] FLAG: --qos-reserved="" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492434 2569 flags.go:64] FLAG: --read-only-port="10255" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492437 2569 flags.go:64] FLAG: --register-node="true" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492439 2569 flags.go:64] FLAG: --register-with-taints="" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492443 2569 flags.go:64] FLAG: --registry-burst="10" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492446 2569 flags.go:64] FLAG: --registry-qps="5" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492450 2569 flags.go:64] FLAG: --reserved-cpus="" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492453 2569 flags.go:64] FLAG: --reserved-memory="" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492457 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492460 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492463 2569 flags.go:64] FLAG: --rotate-certificates="false" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492466 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 06 02:51:25.497903 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492468 2569 flags.go:64] FLAG: --runonce="false" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492471 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492476 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492478 2569 flags.go:64] FLAG: --seccomp-default="false" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492481 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492484 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492487 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492490 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492493 2569 flags.go:64] FLAG: --storage-driver-password="root" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492495 2569 flags.go:64] FLAG: --storage-driver-secure="false" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492498 2569 flags.go:64] FLAG: --storage-driver-table="stats" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492501 2569 flags.go:64] FLAG: --storage-driver-user="root" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492504 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492507 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492510 2569 flags.go:64] FLAG: --system-cgroups="" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492513 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492518 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492521 2569 flags.go:64] FLAG: --tls-cert-file="" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492524 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492528 2569 flags.go:64] FLAG: --tls-min-version="" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492531 2569 flags.go:64] FLAG: --tls-private-key-file="" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492533 2569 flags.go:64] FLAG: --topology-manager-policy="none" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492537 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492539 2569 flags.go:64] FLAG: --topology-manager-scope="container" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492542 2569 flags.go:64] FLAG: --v="2" Sep 06 02:51:25.498522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492546 2569 flags.go:64] FLAG: --version="false" Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492550 2569 flags.go:64] FLAG: --vmodule="" Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492554 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492557 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492663 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492667 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492670 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492673 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492676 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492680 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492683 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492686 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492688 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492691 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492694 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492696 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492699 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492702 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492704 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492707 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 02:51:25.499152 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492709 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492712 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492714 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492717 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492721 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492724 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492726 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492731 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492734 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492737 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492740 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492742 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492745 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492747 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492750 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492753 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492755 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492758 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492760 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492763 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 02:51:25.499700 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492765 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492784 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492788 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492790 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492793 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492795 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492798 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492800 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492803 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492806 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492808 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492811 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492813 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492816 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492819 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492821 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492825 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492828 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492830 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 02:51:25.500213 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492834 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492837 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492840 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492843 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492846 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492848 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492851 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492853 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492856 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492859 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492862 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492864 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492868 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492871 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492876 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492878 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492881 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492884 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492887 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 02:51:25.500685 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492889 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492892 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492895 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492897 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492900 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492902 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492905 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492907 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492910 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492913 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492916 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492919 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492922 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492925 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492927 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492930 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492932 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492935 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492938 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492941 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 02:51:25.501164 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492943 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492946 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492949 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492952 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.492954 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.492960 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.500125 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.500139 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.501085 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.501095 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501151 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501156 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501159 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501163 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501166 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 02:51:25.501645 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501169 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501172 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501175 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501178 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501182 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501185 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501188 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501191 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501194 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501196 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501199 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501201 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501205 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501209 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501212 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501215 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501217 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501220 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501222 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501225 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 02:51:25.502035 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501227 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501230 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501233 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501236 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501239 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501244 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501248 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501251 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501254 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501257 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501260 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501263 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501266 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501268 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501271 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501273 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501276 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501278 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501281 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 02:51:25.502524 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501284 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501286 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501289 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501292 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501294 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501297 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501300 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501302 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501305 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501308 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501310 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501313 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501315 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501318 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501320 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501323 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501326 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501329 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501333 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501335 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 02:51:25.503106 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501338 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501341 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501343 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501345 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501348 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501351 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501353 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501356 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501358 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501361 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501363 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501366 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501368 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501371 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501374 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501376 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501379 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501381 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501384 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501386 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 02:51:25.503607 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501389 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501391 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501394 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501396 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501399 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501401 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501404 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501407 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501409 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501412 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501415 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501418 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501420 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501423 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501425 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 02:51:25.504115 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.501430 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501537 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501542 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501545 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501548 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501551 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501554 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501557 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501559 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501562 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501564 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501567 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501569 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501572 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501574 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501577 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501579 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501582 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501584 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501587 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 06 02:51:25.504477 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501590 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501593 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501595 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501598 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501601 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501604 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501607 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501609 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501612 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501615 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501617 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501620 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501622 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501625 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501627 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501630 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501632 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501635 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501637 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 06 02:51:25.504977 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501640 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501642 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501646 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501651 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501653 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501657 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501659 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501662 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501664 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501667 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501669 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501672 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501674 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501677 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501680 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501682 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501685 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501688 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501691 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501693 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 06 02:51:25.505447 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501695 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501698 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501701 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501704 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501706 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501709 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501711 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501714 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501716 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501718 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501721 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501723 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501726 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501728 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501731 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501734 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501736 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501739 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501741 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501744 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 06 02:51:25.505930 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501746 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501749 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501751 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501755 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501759 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501762 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501765 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501767 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501782 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501786 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501789 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501791 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501795 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501799 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501801 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501804 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501808 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501811 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501814 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 06 02:51:25.506413 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501816 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 06 02:51:25.506948 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:25.501819 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 06 02:51:25.506948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.501824 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 06 02:51:25.506948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.501921 2569 server.go:962] "Client rotation is on, will bootstrap in background" Sep 06 02:51:25.506948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.504137 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 06 02:51:25.506948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.505076 2569 server.go:1019] "Starting client certificate rotation" Sep 06 02:51:25.506948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.505179 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 06 02:51:25.506948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.505215 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 06 02:51:25.507832 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.507819 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 06 02:51:25.508810 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.508794 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 06 02:51:25.523968 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.523847 2569 log.go:25] "Validated CRI v1 runtime API" Sep 06 02:51:25.527051 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.527035 2569 log.go:25] "Validated CRI v1 image API" Sep 06 02:51:25.527851 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.527825 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 06 02:51:25.530407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.530390 2569 fs.go:135] Filesystem UUIDs: map[2f9c86b3-1277-496b-beeb-a468a8cee12c:/dev/nvme0n1p3 69129435-d087-4f05-9cc2-5b77ac1883e8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 06 02:51:25.530455 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.530408 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 06 02:51:25.536584 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.536484 2569 manager.go:216] Machine: {Timestamp:2026-09-06 02:51:25.535080732 +0000 UTC m=+0.362736144 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099206 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d8b397f0231ed97c848d031a7a36 SystemUUID:ec20d8b3-97f0-231e-d97c-848d031a7a36 BootID:8762f1d6-af68-444f-ac1c-569254443f9a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:85:15:f5:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:85:15:f5:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:86:2b:27:6a:74 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 06 02:51:25.536584 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.536583 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 06 02:51:25.536684 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.536650 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 06 02:51:25.539433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.539410 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 06 02:51:25.539558 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.539435 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-131.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 06 02:51:25.540253 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.540244 2569 topology_manager.go:138] "Creating topology manager with none policy" Sep 06 02:51:25.540290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.540256 2569 container_manager_linux.go:309] "Creating device plugin manager" Sep 06 02:51:25.540290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.540263 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 06 02:51:25.540290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.540276 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 06 02:51:25.541399 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.541390 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 06 02:51:25.543970 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.543951 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 06 02:51:25.546431 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546420 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 06 02:51:25.546541 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546532 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 06 02:51:25.546579 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546559 2569 kubelet.go:486] "Attempting to sync node with API server" Sep 06 02:51:25.546579 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546568 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 06 02:51:25.546647 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546583 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 06 02:51:25.546647 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546591 2569 kubelet.go:398] "Adding apiserver pod source" Sep 06 02:51:25.546647 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546600 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 06 02:51:25.546928 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546917 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 06 02:51:25.546961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.546936 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 06 02:51:25.549370 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.549351 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 06 02:51:25.552655 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.552640 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 06 02:51:25.552725 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.552673 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 06 02:51:25.554698 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554687 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 06 02:51:25.554755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554703 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 06 02:51:25.554755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554709 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 06 02:51:25.554755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554714 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 06 02:51:25.554755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554724 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 06 02:51:25.554755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554730 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 06 02:51:25.554755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554744 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 06 02:51:25.554755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554749 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 06 02:51:25.554755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554755 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 06 02:51:25.554980 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554760 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 06 02:51:25.554980 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554790 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 06 02:51:25.554980 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.554796 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 06 02:51:25.556499 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.556485 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 06 02:51:25.556499 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.556497 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 06 02:51:25.559105 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.559077 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 06 02:51:25.559169 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.559090 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 06 02:51:25.560316 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.560304 2569 server.go:1268] "Started kubelet" Sep 06 02:51:25.560430 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.560383 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 06 02:51:25.560550 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.560537 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 06 02:51:25.560801 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.560668 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 06 02:51:25.561175 ip-10-0-141-131 systemd[1]: Started Kubernetes Kubelet. Sep 06 02:51:25.561916 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.561878 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 06 02:51:25.565026 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.564823 2569 server.go:310] "Adding debug handlers to kubelet server" Sep 06 02:51:25.566082 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.566056 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 06 02:51:25.570437 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.570417 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 06 02:51:25.571072 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.571053 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 06 02:51:25.571241 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.571189 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:25.571849 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.571830 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 06 02:51:25.571849 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.571830 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 06 02:51:25.571988 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.571863 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 06 02:51:25.571988 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.571958 2569 reconstruct.go:97] "Volume reconstruction finished" Sep 06 02:51:25.571988 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.571967 2569 reconciler.go:29] "Reconciler: start to sync state" Sep 06 02:51:25.572410 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572363 2569 factory.go:153] Registering CRI-O factory Sep 06 02:51:25.572410 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572377 2569 factory.go:223] Registration of the crio container factory successfully Sep 06 02:51:25.572509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572425 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 06 02:51:25.572509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572435 2569 factory.go:55] Registering systemd factory Sep 06 02:51:25.572509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572441 2569 factory.go:223] Registration of the systemd container factory successfully Sep 06 02:51:25.572509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572458 2569 factory.go:103] Registering Raw factory Sep 06 02:51:25.572509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572471 2569 manager.go:1196] Started watching for new ooms in manager Sep 06 02:51:25.572746 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572692 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-131.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 06 02:51:25.572877 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.572863 2569 manager.go:349] Starting recovery of all containers Sep 06 02:51:25.573948 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.572765 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-131.ec2.internal.18d29b997dacb36c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-131.ec2.internal,UID:ip-10-0-141-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-131.ec2.internal,},FirstTimestamp:2026-09-06 02:51:25.560279916 +0000 UTC m=+0.387935326,LastTimestamp:2026-09-06 02:51:25.560279916 +0000 UTC m=+0.387935326,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-131.ec2.internal,}" Sep 06 02:51:25.580909 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.580862 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 06 02:51:25.582286 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.582270 2569 manager.go:354] Recovery completed Sep 06 02:51:25.582903 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.582873 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-131.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 06 02:51:25.583061 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.583037 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 06 02:51:25.587751 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.587738 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 02:51:25.590381 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.590358 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory" Sep 06 02:51:25.590452 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.590394 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 02:51:25.590452 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.590408 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID" Sep 06 02:51:25.590950 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.590934 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 06 02:51:25.590950 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.590946 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 02:51:25.591066 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.590949 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 06 02:51:25.591066 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.591017 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 06 02:51:25.591681 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.591655 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory" Sep 06 02:51:25.591759 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.591686 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 02:51:25.591759 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.591700 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID" Sep 06 02:51:25.592565 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.592499 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-131.ec2.internal.18d29b997f77fd4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-131.ec2.internal,UID:ip-10-0-141-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-131.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-131.ec2.internal,},FirstTimestamp:2026-09-06 02:51:25.590379854 +0000 UTC m=+0.418035265,LastTimestamp:2026-09-06 02:51:25.590379854 +0000 UTC m=+0.418035265,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-131.ec2.internal,}" Sep 06 02:51:25.593218 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.593204 2569 policy_none.go:49] "None policy: Start" Sep 06 02:51:25.593290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.593223 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 06 02:51:25.593290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.593236 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 06 02:51:25.595282 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.595268 2569 policy_none.go:47] "Start" Sep 06 02:51:25.597280 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.597264 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n99kj" Sep 06 02:51:25.603109 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.603043 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-131.ec2.internal.18d29b997f784db0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-131.ec2.internal,UID:ip-10-0-141-131.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-131.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-131.ec2.internal,},FirstTimestamp:2026-09-06 02:51:25.590400432 +0000 UTC m=+0.418055846,LastTimestamp:2026-09-06 02:51:25.590400432 +0000 UTC m=+0.418055846,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-131.ec2.internal,}" Sep 06 02:51:25.605725 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.605710 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n99kj" Sep 06 02:51:25.620403 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.620390 2569 manager.go:337] "Starting Device Plugin manager" Sep 06 02:51:25.620492 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.620445 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 06 02:51:25.620492 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.620458 2569 server.go:87] "Starting device plugin registration server" Sep 06 02:51:25.620742 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.620726 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 06 02:51:25.620846 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.620748 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 06 02:51:25.622126 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.621989 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 06 02:51:25.622126 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.622059 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 06 02:51:25.622126 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.622068 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 06 02:51:25.623618 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.623527 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 06 02:51:25.623802 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.623748 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:25.644131 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.644111 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 06 02:51:25.656304 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.644158 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 06 02:51:25.656304 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.644176 2569 kubelet.go:2448] "Starting kubelet main sync loop" Sep 06 02:51:25.656304 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.644217 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 06 02:51:25.656304 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.646082 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 02:51:25.721255 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.721230 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 02:51:25.722089 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.722075 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory" Sep 06 02:51:25.722161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.722103 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 02:51:25.722161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.722117 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID" Sep 06 02:51:25.722161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.722138 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.731602 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.731544 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.731602 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.731566 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-131.ec2.internal\": node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:25.744823 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.744804 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal"] Sep 06 02:51:25.744899 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.744862 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 02:51:25.746289 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.746275 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory" Sep 06 02:51:25.746371 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.746307 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 02:51:25.746371 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.746321 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID" Sep 06 02:51:25.748466 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.748451 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 02:51:25.748607 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.748593 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.748651 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.748620 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 02:51:25.749122 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.749107 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory" Sep 06 02:51:25.749191 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.749107 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory" Sep 06 02:51:25.749191 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.749161 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 02:51:25.749191 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.749173 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID" Sep 06 02:51:25.749279 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.749137 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 02:51:25.749279 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.749221 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID" Sep 06 02:51:25.751229 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.751210 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.751321 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.751240 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 02:51:25.751966 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.751940 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory" Sep 06 02:51:25.752074 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.751981 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 02:51:25.752074 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.751996 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID" Sep 06 02:51:25.760766 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.760748 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:25.770284 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.770268 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-131.ec2.internal\" not found" node="ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.772279 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.772263 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68b9565648ee7e4bf7be0710abb3f8e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"68b9565648ee7e4bf7be0710abb3f8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.772358 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.772285 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68b9565648ee7e4bf7be0710abb3f8e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"68b9565648ee7e4bf7be0710abb3f8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.772358 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.772302 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/730a0a3e5dc7d84e9d63b6685c537c58-config\") pod \"kube-apiserver-proxy-ip-10-0-141-131.ec2.internal\" (UID: \"730a0a3e5dc7d84e9d63b6685c537c58\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.774472 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.774457 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-131.ec2.internal\" not found" node="ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.861691 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.861672 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:25.872986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.872968 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/730a0a3e5dc7d84e9d63b6685c537c58-config\") pod \"kube-apiserver-proxy-ip-10-0-141-131.ec2.internal\" (UID: \"730a0a3e5dc7d84e9d63b6685c537c58\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.873047 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.873036 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/730a0a3e5dc7d84e9d63b6685c537c58-config\") pod \"kube-apiserver-proxy-ip-10-0-141-131.ec2.internal\" (UID: \"730a0a3e5dc7d84e9d63b6685c537c58\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.873091 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.873078 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68b9565648ee7e4bf7be0710abb3f8e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"68b9565648ee7e4bf7be0710abb3f8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.873125 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.873102 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68b9565648ee7e4bf7be0710abb3f8e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"68b9565648ee7e4bf7be0710abb3f8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.873161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.873135 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68b9565648ee7e4bf7be0710abb3f8e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"68b9565648ee7e4bf7be0710abb3f8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.873161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:25.873151 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/68b9565648ee7e4bf7be0710abb3f8e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal\" (UID: \"68b9565648ee7e4bf7be0710abb3f8e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:25.962502 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:25.962475 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:26.063264 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:26.063212 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:26.073470 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.073452 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:26.079404 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.079382 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" Sep 06 02:51:26.163334 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:26.163312 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:26.263886 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:26.263864 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:26.364348 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:26.364321 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:26.464869 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:26.464842 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:26.504766 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.504740 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 06 02:51:26.505148 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.504885 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 06 02:51:26.559968 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.559943 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 02:51:26.565295 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:26.565271 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:26.613051 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.612854 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 02:46:26 +0000 UTC" deadline="2028-03-30 08:25:58.146867367 +0000 UTC" Sep 06 02:51:26.613051 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.613021 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13709h34m31.533849835s" Sep 06 02:51:26.658791 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:26.658751 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730a0a3e5dc7d84e9d63b6685c537c58.slice/crio-76931383dc8f8a9892adfabb5a123a427fcd67385d936c4a02d78219379923e3 WatchSource:0}: Error finding container 76931383dc8f8a9892adfabb5a123a427fcd67385d936c4a02d78219379923e3: Status 404 returned error can't find the container with id 76931383dc8f8a9892adfabb5a123a427fcd67385d936c4a02d78219379923e3 Sep 06 02:51:26.663271 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:26.663249 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b9565648ee7e4bf7be0710abb3f8e8.slice/crio-b39fc4c3cf34245fd2ed33c2305eba0ebb21adc44262c9a667fee0e204939fc5 WatchSource:0}: Error finding container b39fc4c3cf34245fd2ed33c2305eba0ebb21adc44262c9a667fee0e204939fc5: Status 404 returned error can't find the container with id b39fc4c3cf34245fd2ed33c2305eba0ebb21adc44262c9a667fee0e204939fc5 Sep 06 02:51:26.664103 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.664087 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 02:51:26.665360 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:26.665335 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-131.ec2.internal\" not found" Sep 06 02:51:26.671347 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.671329 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 06 02:51:26.672201 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.672182 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientMemory" Sep 06 02:51:26.672307 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.672220 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasNoDiskPressure" Sep 06 02:51:26.672307 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.672236 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeHasSufficientPID" Sep 06 02:51:26.706673 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.706640 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 02:51:26.772153 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.772134 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" Sep 06 02:51:26.788236 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.788221 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 06 02:51:26.790413 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.790399 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" Sep 06 02:51:26.801706 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.801691 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 06 02:51:26.912534 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:26.912484 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 02:51:27.548112 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.548081 2569 apiserver.go:52] "Watching apiserver" Sep 06 02:51:27.556564 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.556539 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 06 02:51:27.558083 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.558047 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal","openshift-dns/node-resolver-th72l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal","openshift-multus/network-metrics-daemon-ns26g","openshift-ovn-kubernetes/ovnkube-node-cd8jj","kube-system/konnectivity-agent-49wmq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84","openshift-cluster-node-tuning-operator/tuned-rfg5q","openshift-image-registry/node-ca-t2whv","openshift-multus/multus-6sgk9","openshift-multus/multus-additional-cni-plugins-lm76v","openshift-network-diagnostics/network-check-target-9vd9k","openshift-network-operator/iptables-alerter-klc96","kube-system/global-pull-secret-syncer-lskvr"] Sep 06 02:51:27.560899 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.560876 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.563286 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.563265 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.564325 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.564401 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8mdch\"" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.564868 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.565365 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.566119 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.567161 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.567183 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.567340 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-55tkn\"" Sep 06 02:51:27.567407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.567413 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.567929 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.567441 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 06 02:51:27.567929 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.567514 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:27.567929 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.567604 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 06 02:51:27.568743 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.568707 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:27.568866 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.568812 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:27.571603 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.571583 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 06 02:51:27.572393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.572350 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.574771 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.574746 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:27.575319 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.575287 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 06 02:51:27.575484 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.575465 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l9nh8\"" Sep 06 02:51:27.575544 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.575490 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 06 02:51:27.578144 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.578121 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.580500 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.580479 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.580905 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.580804 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-var-lib-kubelet\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.580905 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.580859 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.580905 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.580889 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e9feeee-1c3b-4713-90e0-420ee974061f-dbus\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.581115 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.580914 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-modprobe-d\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581115 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.580936 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-kubernetes\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581115 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.580958 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysctl-d\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581115 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.580981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-run\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581115 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581005 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-lib-modules\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581115 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581028 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-tuned\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581115 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581075 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-socket-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581112 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bm4m\" (UniqueName: \"kubernetes.io/projected/e35e2b20-920f-4d3b-858e-642153ec251a-kube-api-access-6bm4m\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581140 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da900d7-d73e-4c65-a0d6-c58615da7c53-tmp\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581172 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-sys-fs\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581202 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581236 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysconfig\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581274 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-host\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581305 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581331 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-cnibin\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581355 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581394 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e9feeee-1c3b-4713-90e0-420ee974061f-kubelet-config\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581418 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l54ps\" (UniqueName: \"kubernetes.io/projected/8b26ede6-74e1-428a-b8bb-15ad8032380a-kube-api-access-l54ps\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:27.581450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581442 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-sys\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581464 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581491 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-system-cni-dir\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581516 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581551 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2mjs\" (UniqueName: \"kubernetes.io/projected/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-kube-api-access-r2mjs\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581590 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b492b042-19d0-4186-a1ba-e2917f07b09b-konnectivity-ca\") pod \"konnectivity-agent-49wmq\" (UID: \"b492b042-19d0-4186-a1ba-e2917f07b09b\") " pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581611 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8bw6\" (UniqueName: \"kubernetes.io/projected/7da900d7-d73e-4c65-a0d6-c58615da7c53-kube-api-access-r8bw6\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581630 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b492b042-19d0-4186-a1ba-e2917f07b09b-agent-certs\") pod \"konnectivity-agent-49wmq\" (UID: \"b492b042-19d0-4186-a1ba-e2917f07b09b\") " pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581655 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-registration-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581681 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-device-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581735 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581759 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysctl-conf\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.582094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.581782 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-systemd\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.582664 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.582646 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 06 02:51:27.583113 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.583085 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 06 02:51:27.583113 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.583103 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.583338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.583319 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 06 02:51:27.583937 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.583917 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 06 02:51:27.584031 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.583938 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rw6sj\"" Sep 06 02:51:27.584031 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.583979 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 06 02:51:27.584218 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.584200 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 06 02:51:27.584271 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.584231 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n7r7n\"" Sep 06 02:51:27.586794 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.586766 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.590198 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.590158 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:27.590298 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.590213 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:27.592643 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.592624 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.596306 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.596285 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 06 02:51:27.596668 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.596647 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 06 02:51:27.597261 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.597214 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cbrmc\"" Sep 06 02:51:27.597443 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.597427 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 06 02:51:27.598008 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.597973 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 06 02:51:27.598008 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.597995 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 06 02:51:27.598153 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.598037 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 06 02:51:27.598153 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.598109 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 06 02:51:27.598407 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.598387 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 06 02:51:27.598492 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.598424 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7989f\"" Sep 06 02:51:27.599153 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.599112 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jcc7t\"" Sep 06 02:51:27.599882 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.599570 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 06 02:51:27.599882 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.599659 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2q64q\"" Sep 06 02:51:27.599882 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.599668 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 06 02:51:27.608498 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.608477 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 06 02:51:27.612338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.612316 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 06 02:51:27.648856 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.648808 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" event={"ID":"68b9565648ee7e4bf7be0710abb3f8e8","Type":"ContainerStarted","Data":"b39fc4c3cf34245fd2ed33c2305eba0ebb21adc44262c9a667fee0e204939fc5"} Sep 06 02:51:27.650042 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.650016 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" event={"ID":"730a0a3e5dc7d84e9d63b6685c537c58","Type":"ContainerStarted","Data":"76931383dc8f8a9892adfabb5a123a427fcd67385d936c4a02d78219379923e3"} Sep 06 02:51:27.661617 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.661590 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9zlv9" Sep 06 02:51:27.670642 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.670620 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9zlv9" Sep 06 02:51:27.673133 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.673114 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 06 02:51:27.682739 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7lnx\" (UniqueName: \"kubernetes.io/projected/fda1e155-d697-4ae3-9960-645af0f169e2-kube-api-access-l7lnx\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.682842 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682752 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-cnibin\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.682842 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682813 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-cnibin\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.682842 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682835 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l54ps\" (UniqueName: \"kubernetes.io/projected/8b26ede6-74e1-428a-b8bb-15ad8032380a-kube-api-access-l54ps\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:27.682989 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682852 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-sys\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.682989 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682872 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-kubelet\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.682989 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682904 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-system-cni-dir\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.682989 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682929 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682989 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-system-cni-dir\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682986 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-sys\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.683017 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683015 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-node-log\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683052 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2mjs\" (UniqueName: \"kubernetes.io/projected/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-kube-api-access-r2mjs\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.682989 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-cnibin\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.683090 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret podName:5e9feeee-1c3b-4713-90e0-420ee974061f nodeName:}" failed. No retries permitted until 2026-09-06 02:51:28.18306842 +0000 UTC m=+3.010723845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret") pod "global-pull-secret-syncer-lskvr" (UID: "5e9feeee-1c3b-4713-90e0-420ee974061f") : object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683123 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxzm8\" (UniqueName: \"kubernetes.io/projected/255dee4d-6ebc-4384-9f76-d004209a3ac0-kube-api-access-bxzm8\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683144 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-ovnkube-config\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683171 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd61d73b-ea22-4a94-ba88-ae9995156558-iptables-alerter-script\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.683215 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683205 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-etc-kubernetes\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683234 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-systemd\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683258 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-cni-bin\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683289 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-cni-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683325 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683367 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysctl-conf\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683394 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-systemd\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683424 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-etc-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683449 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-log-socket\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683476 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda1e155-d697-4ae3-9960-645af0f169e2-ovn-node-metrics-cert\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683502 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed7824d5-86f7-4475-ace5-1507ff0c3c47-cni-binary-copy\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683492 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-systemd\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683526 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-hostroot\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683560 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysctl-conf\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683565 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683615 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-kubernetes\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683637 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-env-overrides\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.683755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683660 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnchf\" (UniqueName: \"kubernetes.io/projected/ed7824d5-86f7-4475-ace5-1507ff0c3c47-kube-api-access-cnchf\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683689 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-socket-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683710 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljp4t\" (UniqueName: \"kubernetes.io/projected/74b8b94d-ef8b-4297-9c82-ba364256fa95-kube-api-access-ljp4t\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683727 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683733 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-kubernetes\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683744 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-sys-fs\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683820 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-host\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683848 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-socket-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-var-lib-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683894 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74b8b94d-ef8b-4297-9c82-ba364256fa95-serviceca\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683913 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-sys-fs\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683953 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.683982 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684003 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-cni-binary-copy\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684020 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e9feeee-1c3b-4713-90e0-420ee974061f-kubelet-config\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-ovn\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684071 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-cni-netd\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.684535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684085 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-host\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684096 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-ovnkube-script-lib\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684101 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684148 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5e9feeee-1c3b-4713-90e0-420ee974061f-kubelet-config\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684179 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684207 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-etc-selinux\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684209 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/255dee4d-6ebc-4384-9f76-d004209a3ac0-hosts-file\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684261 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684282 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e35e2b20-920f-4d3b-858e-642153ec251a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684298 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255dee4d-6ebc-4384-9f76-d004209a3ac0-tmp-dir\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684324 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-run-netns\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684348 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-kubelet\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684372 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-systemd-units\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-slash\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684418 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74b8b94d-ef8b-4297-9c82-ba364256fa95-host\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684442 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-system-cni-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b492b042-19d0-4186-a1ba-e2917f07b09b-konnectivity-ca\") pod \"konnectivity-agent-49wmq\" (UID: \"b492b042-19d0-4186-a1ba-e2917f07b09b\") " pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:27.685393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684499 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8bw6\" (UniqueName: \"kubernetes.io/projected/7da900d7-d73e-4c65-a0d6-c58615da7c53-kube-api-access-r8bw6\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd61d73b-ea22-4a94-ba88-ae9995156558-host-slash\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684548 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldvnz\" (UniqueName: \"kubernetes.io/projected/cd61d73b-ea22-4a94-ba88-ae9995156558-kube-api-access-ldvnz\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b492b042-19d0-4186-a1ba-e2917f07b09b-agent-certs\") pod \"konnectivity-agent-49wmq\" (UID: \"b492b042-19d0-4186-a1ba-e2917f07b09b\") " pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684615 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-registration-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684648 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-device-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684675 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684705 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-registration-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684747 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-device-dir\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684761 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-var-lib-kubelet\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684708 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-var-lib-kubelet\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684810 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-tuned\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684848 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-socket-dir-parent\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684868 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e9feeee-1c3b-4713-90e0-420ee974061f-dbus\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684895 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-modprobe-d\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684920 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysctl-d\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.686213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684942 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-run\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684966 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-lib-modules\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.684990 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-k8s-cni-cncf-io\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685014 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-cni-bin\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-daemon-config\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bm4m\" (UniqueName: \"kubernetes.io/projected/e35e2b20-920f-4d3b-858e-642153ec251a-kube-api-access-6bm4m\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685093 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da900d7-d73e-4c65-a0d6-c58615da7c53-tmp\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685140 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-netns\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685163 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-cni-multus\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685187 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-conf-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685214 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-multus-certs\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685187 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-run\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685244 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b492b042-19d0-4186-a1ba-e2917f07b09b-konnectivity-ca\") pod \"konnectivity-agent-49wmq\" (UID: \"b492b042-19d0-4186-a1ba-e2917f07b09b\") " pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685251 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e35e2b20-920f-4d3b-858e-642153ec251a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685293 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685313 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-lib-modules\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.687056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685336 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:27.687823 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685343 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5e9feeee-1c3b-4713-90e0-420ee974061f-dbus\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:27.687823 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685352 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-modprobe-d\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.687823 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685378 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysconfig\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.687823 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.685427 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:27.687823 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685470 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 06 02:51:27.687823 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685488 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysctl-d\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.687823 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.685506 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs podName:8b26ede6-74e1-428a-b8bb-15ad8032380a nodeName:}" failed. No retries permitted until 2026-09-06 02:51:28.185488632 +0000 UTC m=+3.013144049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs") pod "network-metrics-daemon-ns26g" (UID: "8b26ede6-74e1-428a-b8bb-15ad8032380a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:27.687823 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.685505 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-sysconfig\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.689503 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.689477 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7da900d7-d73e-4c65-a0d6-c58615da7c53-etc-tuned\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.689750 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.689726 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b492b042-19d0-4186-a1ba-e2917f07b09b-agent-certs\") pod \"konnectivity-agent-49wmq\" (UID: \"b492b042-19d0-4186-a1ba-e2917f07b09b\") " pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:27.689911 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.689894 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da900d7-d73e-4c65-a0d6-c58615da7c53-tmp\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.701794 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.701763 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8bw6\" (UniqueName: \"kubernetes.io/projected/7da900d7-d73e-4c65-a0d6-c58615da7c53-kube-api-access-r8bw6\") pod \"tuned-rfg5q\" (UID: \"7da900d7-d73e-4c65-a0d6-c58615da7c53\") " pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.702056 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.702035 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bm4m\" (UniqueName: \"kubernetes.io/projected/e35e2b20-920f-4d3b-858e-642153ec251a-kube-api-access-6bm4m\") pod \"multus-additional-cni-plugins-lm76v\" (UID: \"e35e2b20-920f-4d3b-858e-642153ec251a\") " pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.702288 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.702263 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l54ps\" (UniqueName: \"kubernetes.io/projected/8b26ede6-74e1-428a-b8bb-15ad8032380a-kube-api-access-l54ps\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:27.702502 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.702485 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2mjs\" (UniqueName: \"kubernetes.io/projected/d33815e4-f2b2-4fe5-bd7e-d01c9d51469a-kube-api-access-r2mjs\") pod \"aws-ebs-csi-driver-node-8jr84\" (UID: \"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.785753 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.785726 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255dee4d-6ebc-4384-9f76-d004209a3ac0-tmp-dir\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.786154 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786113 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-run-netns\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786247 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786187 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-kubelet\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786306 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786252 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-kubelet\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786349 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786305 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-run-netns\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786349 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786339 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-systemd-units\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786454 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786371 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-slash\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786454 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74b8b94d-ef8b-4297-9c82-ba364256fa95-host\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.786454 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786429 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-system-cni-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.786454 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786427 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-systemd-units\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd61d73b-ea22-4a94-ba88-ae9995156558-host-slash\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786486 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255dee4d-6ebc-4384-9f76-d004209a3ac0-tmp-dir\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786509 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74b8b94d-ef8b-4297-9c82-ba364256fa95-host\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786494 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldvnz\" (UniqueName: \"kubernetes.io/projected/cd61d73b-ea22-4a94-ba88-ae9995156558-kube-api-access-ldvnz\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786493 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-slash\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786561 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786567 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd61d73b-ea22-4a94-ba88-ae9995156558-host-slash\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786590 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-socket-dir-parent\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786622 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-system-cni-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.786657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786646 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-k8s-cni-cncf-io\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786667 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-socket-dir-parent\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786684 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786688 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-cni-bin\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786724 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-daemon-config\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786740 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-k8s-cni-cncf-io\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786762 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786818 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-cni-bin\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786840 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786867 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-netns\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-cni-multus\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786945 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-conf-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.786977 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-multus-certs\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787009 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-cni-multus\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787010 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787053 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-run-ovn-kubernetes\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787064 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7lnx\" (UniqueName: \"kubernetes.io/projected/fda1e155-d697-4ae3-9960-645af0f169e2-kube-api-access-l7lnx\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.787194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787125 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-multus-certs\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787124 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-conf-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787134 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-cnibin\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-kubelet\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787234 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-node-log\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787250 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-cnibin\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxzm8\" (UniqueName: \"kubernetes.io/projected/255dee4d-6ebc-4384-9f76-d004209a3ac0-kube-api-access-bxzm8\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787291 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-var-lib-kubelet\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787297 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-ovnkube-config\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787325 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-node-log\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787333 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd61d73b-ea22-4a94-ba88-ae9995156558-iptables-alerter-script\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787354 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-host-run-netns\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787384 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-etc-kubernetes\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787439 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-daemon-config\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787445 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-systemd\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787494 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-systemd\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-cni-bin\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787633 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-cni-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787663 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-etc-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787686 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-log-socket\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787707 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda1e155-d697-4ae3-9960-645af0f169e2-ovn-node-metrics-cert\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787728 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed7824d5-86f7-4475-ace5-1507ff0c3c47-cni-binary-copy\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787744 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-hostroot\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787765 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-env-overrides\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787798 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnchf\" (UniqueName: \"kubernetes.io/projected/ed7824d5-86f7-4475-ace5-1507ff0c3c47-kube-api-access-cnchf\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787823 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljp4t\" (UniqueName: \"kubernetes.io/projected/74b8b94d-ef8b-4297-9c82-ba364256fa95-kube-api-access-ljp4t\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787840 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787869 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-var-lib-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.787900 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74b8b94d-ef8b-4297-9c82-ba364256fa95-serviceca\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788009 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd61d73b-ea22-4a94-ba88-ae9995156558-iptables-alerter-script\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788089 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-etc-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788104 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-ovnkube-config\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788140 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-etc-kubernetes\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788189 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-cni-bin\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788189 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-multus-cni-dir\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788227 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-log-socket\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.788961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788293 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed7824d5-86f7-4475-ace5-1507ff0c3c47-cni-binary-copy\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788340 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed7824d5-86f7-4475-ace5-1507ff0c3c47-hostroot\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788348 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-ovn\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788790 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-var-lib-openvswitch\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788910 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-run-ovn\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788914 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-cni-netd\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.788962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-ovnkube-script-lib\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.789045 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fda1e155-d697-4ae3-9960-645af0f169e2-host-cni-netd\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.789122 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/255dee4d-6ebc-4384-9f76-d004209a3ac0-hosts-file\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.789122 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-env-overrides\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.789226 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74b8b94d-ef8b-4297-9c82-ba364256fa95-serviceca\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.789790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.789236 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/255dee4d-6ebc-4384-9f76-d004209a3ac0-hosts-file\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.790406 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.790354 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fda1e155-d697-4ae3-9960-645af0f169e2-ovnkube-script-lib\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.792452 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.792431 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda1e155-d697-4ae3-9960-645af0f169e2-ovn-node-metrics-cert\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.802551 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.802481 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldvnz\" (UniqueName: \"kubernetes.io/projected/cd61d73b-ea22-4a94-ba88-ae9995156558-kube-api-access-ldvnz\") pod \"iptables-alerter-klc96\" (UID: \"cd61d73b-ea22-4a94-ba88-ae9995156558\") " pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.803766 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.803744 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 02:51:27.803888 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.803795 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 02:51:27.803888 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.803812 2569 projected.go:196] Error preparing data for projected volume kube-api-access-ghw5p for pod openshift-network-diagnostics/network-check-target-9vd9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:27.803888 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.803751 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxzm8\" (UniqueName: \"kubernetes.io/projected/255dee4d-6ebc-4384-9f76-d004209a3ac0-kube-api-access-bxzm8\") pod \"node-resolver-th72l\" (UID: \"255dee4d-6ebc-4384-9f76-d004209a3ac0\") " pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.804080 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:27.803896 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p podName:c3e1dd0b-14f8-49eb-a085-2883236a1af5 nodeName:}" failed. No retries permitted until 2026-09-06 02:51:28.303874771 +0000 UTC m=+3.131530188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ghw5p" (UniqueName: "kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p") pod "network-check-target-9vd9k" (UID: "c3e1dd0b-14f8-49eb-a085-2883236a1af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:27.804342 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.804308 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7lnx\" (UniqueName: \"kubernetes.io/projected/fda1e155-d697-4ae3-9960-645af0f169e2-kube-api-access-l7lnx\") pod \"ovnkube-node-cd8jj\" (UID: \"fda1e155-d697-4ae3-9960-645af0f169e2\") " pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:27.804449 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.804399 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnchf\" (UniqueName: \"kubernetes.io/projected/ed7824d5-86f7-4475-ace5-1507ff0c3c47-kube-api-access-cnchf\") pod \"multus-6sgk9\" (UID: \"ed7824d5-86f7-4475-ace5-1507ff0c3c47\") " pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.805067 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.805047 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljp4t\" (UniqueName: \"kubernetes.io/projected/74b8b94d-ef8b-4297-9c82-ba364256fa95-kube-api-access-ljp4t\") pod \"node-ca-t2whv\" (UID: \"74b8b94d-ef8b-4297-9c82-ba364256fa95\") " pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.876848 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.876820 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" Sep 06 02:51:27.884679 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.884657 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lm76v" Sep 06 02:51:27.895934 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.895909 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" Sep 06 02:51:27.900891 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.900873 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:27.909880 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.909856 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t2whv" Sep 06 02:51:27.918782 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.918758 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-klc96" Sep 06 02:51:27.928801 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.928765 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-th72l" Sep 06 02:51:27.936805 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.936788 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6sgk9" Sep 06 02:51:27.942735 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:27.942713 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:28.096070 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:28.095992 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 06 02:51:28.193349 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:28.193312 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:28.193527 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:28.193368 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:28.193527 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:28.193501 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:28.193527 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:28.193504 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:28.193721 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:28.193569 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret podName:5e9feeee-1c3b-4713-90e0-420ee974061f nodeName:}" failed. No retries permitted until 2026-09-06 02:51:29.193550665 +0000 UTC m=+4.021206086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret") pod "global-pull-secret-syncer-lskvr" (UID: "5e9feeee-1c3b-4713-90e0-420ee974061f") : object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:28.193721 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:28.193592 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs podName:8b26ede6-74e1-428a-b8bb-15ad8032380a nodeName:}" failed. No retries permitted until 2026-09-06 02:51:29.193580925 +0000 UTC m=+4.021236325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs") pod "network-metrics-daemon-ns26g" (UID: "8b26ede6-74e1-428a-b8bb-15ad8032380a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:28.395330 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:28.395251 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:28.395471 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:28.395402 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 02:51:28.395471 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:28.395424 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 02:51:28.395471 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:28.395435 2569 projected.go:196] Error preparing data for projected volume kube-api-access-ghw5p for pod openshift-network-diagnostics/network-check-target-9vd9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:28.395617 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:28.395500 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p podName:c3e1dd0b-14f8-49eb-a085-2883236a1af5 nodeName:}" failed. No retries permitted until 2026-09-06 02:51:29.39548057 +0000 UTC m=+4.223135971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghw5p" (UniqueName: "kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p") pod "network-check-target-9vd9k" (UID: "c3e1dd0b-14f8-49eb-a085-2883236a1af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:28.673610 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:28.673577 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 02:46:28 +0000 UTC" deadline="2028-03-09 10:52:29.970961266 +0000 UTC" Sep 06 02:51:28.673610 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:28.673606 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13208h1m1.297358488s" Sep 06 02:51:28.675068 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.675041 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33815e4_f2b2_4fe5_bd7e_d01c9d51469a.slice/crio-8aeea12f16a04bf9b955501030f5859f1571604bf081c1d5590e210c1d0f4fe1 WatchSource:0}: Error finding container 8aeea12f16a04bf9b955501030f5859f1571604bf081c1d5590e210c1d0f4fe1: Status 404 returned error can't find the container with id 8aeea12f16a04bf9b955501030f5859f1571604bf081c1d5590e210c1d0f4fe1 Sep 06 02:51:28.679674 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.679554 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35e2b20_920f_4d3b_858e_642153ec251a.slice/crio-a9cf184907e7c79ff3641a4d1c80d8f9432deaa980bed4ba8d2065811ae5dff8 WatchSource:0}: Error finding container a9cf184907e7c79ff3641a4d1c80d8f9432deaa980bed4ba8d2065811ae5dff8: Status 404 returned error can't find the container with id a9cf184907e7c79ff3641a4d1c80d8f9432deaa980bed4ba8d2065811ae5dff8 Sep 06 02:51:28.683450 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.683423 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7824d5_86f7_4475_ace5_1507ff0c3c47.slice/crio-c05a3138e8fc09560234cba786598a972b201e53d2b4f74df3d9659050e426a6 WatchSource:0}: Error finding container c05a3138e8fc09560234cba786598a972b201e53d2b4f74df3d9659050e426a6: Status 404 returned error can't find the container with id c05a3138e8fc09560234cba786598a972b201e53d2b4f74df3d9659050e426a6 Sep 06 02:51:28.684721 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.684684 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b8b94d_ef8b_4297_9c82_ba364256fa95.slice/crio-f75102dff154f2b34eb499918661e513e6732e08640e1f553a873bf9675747ab WatchSource:0}: Error finding container f75102dff154f2b34eb499918661e513e6732e08640e1f553a873bf9675747ab: Status 404 returned error can't find the container with id f75102dff154f2b34eb499918661e513e6732e08640e1f553a873bf9675747ab Sep 06 02:51:28.685500 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.685479 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda1e155_d697_4ae3_9960_645af0f169e2.slice/crio-f57c8199196ca31e84e62340719a7f88795a89ef74dd8d4d171378cbaf00f227 WatchSource:0}: Error finding container f57c8199196ca31e84e62340719a7f88795a89ef74dd8d4d171378cbaf00f227: Status 404 returned error can't find the container with id f57c8199196ca31e84e62340719a7f88795a89ef74dd8d4d171378cbaf00f227 Sep 06 02:51:28.687639 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.687100 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb492b042_19d0_4186_a1ba_e2917f07b09b.slice/crio-b474920a3dfad9cafb3983d5c4cd89cd4a9144be0e6cf82c1eb57a5f050aeb82 WatchSource:0}: Error finding container b474920a3dfad9cafb3983d5c4cd89cd4a9144be0e6cf82c1eb57a5f050aeb82: Status 404 returned error can't find the container with id b474920a3dfad9cafb3983d5c4cd89cd4a9144be0e6cf82c1eb57a5f050aeb82 Sep 06 02:51:28.688160 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.688011 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd61d73b_ea22_4a94_ba88_ae9995156558.slice/crio-28d16238d64fa3b0781e9331bbcc234c0802f3d2a70d99453807ee02e9003e01 WatchSource:0}: Error finding container 28d16238d64fa3b0781e9331bbcc234c0802f3d2a70d99453807ee02e9003e01: Status 404 returned error can't find the container with id 28d16238d64fa3b0781e9331bbcc234c0802f3d2a70d99453807ee02e9003e01 Sep 06 02:51:28.690331 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.690297 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255dee4d_6ebc_4384_9f76_d004209a3ac0.slice/crio-c999b5451597e1369954542d0e94070a4ec5950c2fae82e825b7369bac4a47f1 WatchSource:0}: Error finding container c999b5451597e1369954542d0e94070a4ec5950c2fae82e825b7369bac4a47f1: Status 404 returned error can't find the container with id c999b5451597e1369954542d0e94070a4ec5950c2fae82e825b7369bac4a47f1 Sep 06 02:51:28.691029 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:51:28.691010 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da900d7_d73e_4c65_a0d6_c58615da7c53.slice/crio-e02569dc6d3a599295b751e58334d107885008f2633bc2759fff99af51812d27 WatchSource:0}: Error finding container e02569dc6d3a599295b751e58334d107885008f2633bc2759fff99af51812d27: Status 404 returned error can't find the container with id e02569dc6d3a599295b751e58334d107885008f2633bc2759fff99af51812d27 Sep 06 02:51:29.202490 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.201741 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:29.202490 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.201801 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:29.202490 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.201984 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:29.202490 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.202056 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs podName:8b26ede6-74e1-428a-b8bb-15ad8032380a nodeName:}" failed. No retries permitted until 2026-09-06 02:51:31.202035578 +0000 UTC m=+6.029690994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs") pod "network-metrics-daemon-ns26g" (UID: "8b26ede6-74e1-428a-b8bb-15ad8032380a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:29.203242 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.203138 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:29.203242 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.203204 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret podName:5e9feeee-1c3b-4713-90e0-420ee974061f nodeName:}" failed. No retries permitted until 2026-09-06 02:51:31.203186268 +0000 UTC m=+6.030841687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret") pod "global-pull-secret-syncer-lskvr" (UID: "5e9feeee-1c3b-4713-90e0-420ee974061f") : object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:29.404627 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.404580 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:29.404821 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.404784 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 02:51:29.404904 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.404810 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 02:51:29.404904 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.404837 2569 projected.go:196] Error preparing data for projected volume kube-api-access-ghw5p for pod openshift-network-diagnostics/network-check-target-9vd9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:29.405019 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.404906 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p podName:c3e1dd0b-14f8-49eb-a085-2883236a1af5 nodeName:}" failed. No retries permitted until 2026-09-06 02:51:31.404885561 +0000 UTC m=+6.232540977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghw5p" (UniqueName: "kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p") pod "network-check-target-9vd9k" (UID: "c3e1dd0b-14f8-49eb-a085-2883236a1af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:29.652621 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.652544 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:29.652784 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.652701 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:29.653593 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.653154 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:29.653593 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.653252 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:29.653593 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.653316 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:29.653593 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:29.653400 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:29.673779 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.673739 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" event={"ID":"7da900d7-d73e-4c65-a0d6-c58615da7c53","Type":"ContainerStarted","Data":"e02569dc6d3a599295b751e58334d107885008f2633bc2759fff99af51812d27"} Sep 06 02:51:29.674605 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.673889 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 02:46:28 +0000 UTC" deadline="2028-02-05 17:18:28.630786309 +0000 UTC" Sep 06 02:51:29.674605 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.673935 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12422h26m58.956855263s" Sep 06 02:51:29.690549 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.690432 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klc96" event={"ID":"cd61d73b-ea22-4a94-ba88-ae9995156558","Type":"ContainerStarted","Data":"28d16238d64fa3b0781e9331bbcc234c0802f3d2a70d99453807ee02e9003e01"} Sep 06 02:51:29.695021 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.694989 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-49wmq" event={"ID":"b492b042-19d0-4186-a1ba-e2917f07b09b","Type":"ContainerStarted","Data":"b474920a3dfad9cafb3983d5c4cd89cd4a9144be0e6cf82c1eb57a5f050aeb82"} Sep 06 02:51:29.699513 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.699480 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t2whv" event={"ID":"74b8b94d-ef8b-4297-9c82-ba364256fa95","Type":"ContainerStarted","Data":"f75102dff154f2b34eb499918661e513e6732e08640e1f553a873bf9675747ab"} Sep 06 02:51:29.703114 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.703047 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6sgk9" event={"ID":"ed7824d5-86f7-4475-ace5-1507ff0c3c47","Type":"ContainerStarted","Data":"c05a3138e8fc09560234cba786598a972b201e53d2b4f74df3d9659050e426a6"} Sep 06 02:51:29.719626 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.719519 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm76v" event={"ID":"e35e2b20-920f-4d3b-858e-642153ec251a","Type":"ContainerStarted","Data":"a9cf184907e7c79ff3641a4d1c80d8f9432deaa980bed4ba8d2065811ae5dff8"} Sep 06 02:51:29.744720 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.744244 2569 generic.go:356] "Generic (PLEG): container finished" podID="68b9565648ee7e4bf7be0710abb3f8e8" containerID="72f67058a8cbd532c499f9859f7b2d996162590b907a85b0c726acfdb3fe6861" exitCode=0 Sep 06 02:51:29.744720 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.744418 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" event={"ID":"68b9565648ee7e4bf7be0710abb3f8e8","Type":"ContainerDied","Data":"72f67058a8cbd532c499f9859f7b2d996162590b907a85b0c726acfdb3fe6861"} Sep 06 02:51:29.768635 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.768600 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" event={"ID":"730a0a3e5dc7d84e9d63b6685c537c58","Type":"ContainerStarted","Data":"19948a7afe105aec93f58b0d91cbcfe839dcde2aff6977854470fe7d86b06333"} Sep 06 02:51:29.774552 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.774519 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"f57c8199196ca31e84e62340719a7f88795a89ef74dd8d4d171378cbaf00f227"} Sep 06 02:51:29.785096 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.785037 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-131.ec2.internal" podStartSLOduration=2.785015158 podStartE2EDuration="2.785015158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:29.784580889 +0000 UTC m=+4.612236307" watchObservedRunningTime="2026-09-06 02:51:29.785015158 +0000 UTC m=+4.612670584" Sep 06 02:51:29.794133 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.794100 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-th72l" event={"ID":"255dee4d-6ebc-4384-9f76-d004209a3ac0","Type":"ContainerStarted","Data":"c999b5451597e1369954542d0e94070a4ec5950c2fae82e825b7369bac4a47f1"} Sep 06 02:51:29.805138 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:29.805100 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" event={"ID":"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a","Type":"ContainerStarted","Data":"8aeea12f16a04bf9b955501030f5859f1571604bf081c1d5590e210c1d0f4fe1"} Sep 06 02:51:30.831371 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:30.830992 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" event={"ID":"68b9565648ee7e4bf7be0710abb3f8e8","Type":"ContainerStarted","Data":"6dea235b63fad8bf79ce50781dc51adedfd7ce53c6b4e2607492c92d1fb58dd3"} Sep 06 02:51:30.850029 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:30.849948 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-131.ec2.internal" podStartSLOduration=3.8499250910000002 podStartE2EDuration="3.849925091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:30.849058534 +0000 UTC m=+5.676713990" watchObservedRunningTime="2026-09-06 02:51:30.849925091 +0000 UTC m=+5.677580516" Sep 06 02:51:31.221976 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:31.221881 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:31.221976 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:31.221940 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:31.222221 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.222087 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:31.222221 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.222155 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret podName:5e9feeee-1c3b-4713-90e0-420ee974061f nodeName:}" failed. No retries permitted until 2026-09-06 02:51:35.222135601 +0000 UTC m=+10.049791023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret") pod "global-pull-secret-syncer-lskvr" (UID: "5e9feeee-1c3b-4713-90e0-420ee974061f") : object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:31.222593 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.222567 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:31.222694 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.222628 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs podName:8b26ede6-74e1-428a-b8bb-15ad8032380a nodeName:}" failed. No retries permitted until 2026-09-06 02:51:35.222610519 +0000 UTC m=+10.050265945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs") pod "network-metrics-daemon-ns26g" (UID: "8b26ede6-74e1-428a-b8bb-15ad8032380a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:31.423422 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:31.423377 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:31.423629 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.423576 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 02:51:31.423629 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.423600 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 02:51:31.423629 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.423614 2569 projected.go:196] Error preparing data for projected volume kube-api-access-ghw5p for pod openshift-network-diagnostics/network-check-target-9vd9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:31.423793 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.423678 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p podName:c3e1dd0b-14f8-49eb-a085-2883236a1af5 nodeName:}" failed. No retries permitted until 2026-09-06 02:51:35.423658761 +0000 UTC m=+10.251314164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghw5p" (UniqueName: "kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p") pod "network-check-target-9vd9k" (UID: "c3e1dd0b-14f8-49eb-a085-2883236a1af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:31.647434 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:31.644991 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:31.647434 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.645173 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:31.647434 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:31.645237 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:31.647434 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.645313 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:31.647434 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:31.645679 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:31.647434 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:31.645785 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:33.645467 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:33.644945 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:33.645467 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:33.645073 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:33.645467 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:33.645378 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:33.646080 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:33.645517 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:33.646080 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:33.645605 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:33.646080 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:33.645708 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:35.258196 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:35.258156 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:35.258637 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:35.258221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:35.258637 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.258349 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:35.258637 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.258416 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret podName:5e9feeee-1c3b-4713-90e0-420ee974061f nodeName:}" failed. No retries permitted until 2026-09-06 02:51:43.258395951 +0000 UTC m=+18.086051366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret") pod "global-pull-secret-syncer-lskvr" (UID: "5e9feeee-1c3b-4713-90e0-420ee974061f") : object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:35.258826 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.258349 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:35.258936 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.258887 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs podName:8b26ede6-74e1-428a-b8bb-15ad8032380a nodeName:}" failed. No retries permitted until 2026-09-06 02:51:43.258864237 +0000 UTC m=+18.086519653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs") pod "network-metrics-daemon-ns26g" (UID: "8b26ede6-74e1-428a-b8bb-15ad8032380a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:35.460097 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:35.460057 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:35.460270 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.460251 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 02:51:35.460270 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.460271 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 02:51:35.460357 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.460284 2569 projected.go:196] Error preparing data for projected volume kube-api-access-ghw5p for pod openshift-network-diagnostics/network-check-target-9vd9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:35.460357 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.460347 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p podName:c3e1dd0b-14f8-49eb-a085-2883236a1af5 nodeName:}" failed. No retries permitted until 2026-09-06 02:51:43.460328541 +0000 UTC m=+18.287983943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghw5p" (UniqueName: "kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p") pod "network-check-target-9vd9k" (UID: "c3e1dd0b-14f8-49eb-a085-2883236a1af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:35.644967 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:35.644770 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:35.644967 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:35.644799 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:35.645321 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.645275 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:35.646752 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.646722 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:35.646986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:35.646749 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:35.647972 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:35.647944 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:37.645657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:37.645571 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:37.646149 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:37.645571 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:37.646149 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:37.645755 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:37.646149 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:37.645758 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:37.646149 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:37.645849 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:37.646149 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:37.645923 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:39.644892 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:39.644855 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:39.645290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:39.644855 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:39.645290 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:39.644950 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:39.645290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:39.644868 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:39.645290 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:39.645057 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:39.645290 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:39.645164 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:41.645414 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:41.645377 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:41.645414 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:41.645399 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:41.645960 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:41.645377 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:41.645960 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:41.645517 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:41.645960 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:41.645618 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:41.645960 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:41.645675 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:43.323472 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:43.323438 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:43.323942 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:43.323500 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:43.323942 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.323579 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:43.323942 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.323592 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:43.323942 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.323640 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret podName:5e9feeee-1c3b-4713-90e0-420ee974061f nodeName:}" failed. No retries permitted until 2026-09-06 02:51:59.323624486 +0000 UTC m=+34.151279889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret") pod "global-pull-secret-syncer-lskvr" (UID: "5e9feeee-1c3b-4713-90e0-420ee974061f") : object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:43.323942 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.323655 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs podName:8b26ede6-74e1-428a-b8bb-15ad8032380a nodeName:}" failed. No retries permitted until 2026-09-06 02:51:59.323648893 +0000 UTC m=+34.151304290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs") pod "network-metrics-daemon-ns26g" (UID: "8b26ede6-74e1-428a-b8bb-15ad8032380a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:43.525358 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:43.525260 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:43.525522 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.525500 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 02:51:43.527523 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.527480 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 02:51:43.527848 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.527550 2569 projected.go:196] Error preparing data for projected volume kube-api-access-ghw5p for pod openshift-network-diagnostics/network-check-target-9vd9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:43.527955 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.527914 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p podName:c3e1dd0b-14f8-49eb-a085-2883236a1af5 nodeName:}" failed. No retries permitted until 2026-09-06 02:51:59.527895371 +0000 UTC m=+34.355550770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghw5p" (UniqueName: "kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p") pod "network-check-target-9vd9k" (UID: "c3e1dd0b-14f8-49eb-a085-2883236a1af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:43.644803 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:43.644714 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:43.644803 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:43.644732 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:43.644803 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:43.644732 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:43.645060 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.644852 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:43.645060 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.644946 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:43.645060 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:43.645014 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:45.645283 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:45.645254 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:45.645737 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:45.645320 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:45.645737 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:45.645412 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:45.645737 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:45.645505 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:45.645737 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:45.645614 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:45.645737 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:45.645700 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:47.645139 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.644984 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:47.645955 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.644984 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:47.645955 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:47.645207 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:47.645955 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.645002 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:47.645955 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:47.645484 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:47.645955 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:47.645307 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:47.868366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.868303 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" event={"ID":"7da900d7-d73e-4c65-a0d6-c58615da7c53","Type":"ContainerStarted","Data":"d857229d153e209ac75b5ba57b5eff560dbae8b51305f6edc0ba4625c21293d0"} Sep 06 02:51:47.869948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.869915 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-49wmq" event={"ID":"b492b042-19d0-4186-a1ba-e2917f07b09b","Type":"ContainerStarted","Data":"7e0485b39143071bc333de50e6a053275e885fbd6565cc326c423df6abb51ff6"} Sep 06 02:51:47.871627 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.871583 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t2whv" event={"ID":"74b8b94d-ef8b-4297-9c82-ba364256fa95","Type":"ContainerStarted","Data":"2825693eb9b18ea8b3fad95d117d26f0f9f4c31fb92da55e45f1bcad443d7b4f"} Sep 06 02:51:47.873301 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.873282 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6sgk9" event={"ID":"ed7824d5-86f7-4475-ace5-1507ff0c3c47","Type":"ContainerStarted","Data":"a5fd09491d7bb7587275f7987985d6723ee6ff093164ba3a3bffb8331cd5e8ac"} Sep 06 02:51:47.874934 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.874908 2569 generic.go:356] "Generic (PLEG): container finished" podID="e35e2b20-920f-4d3b-858e-642153ec251a" containerID="0c0d6bafd100562304f29154ef96c865deea4188568f590077939cff69849783" exitCode=0 Sep 06 02:51:47.875045 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.875001 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm76v" event={"ID":"e35e2b20-920f-4d3b-858e-642153ec251a","Type":"ContainerDied","Data":"0c0d6bafd100562304f29154ef96c865deea4188568f590077939cff69849783"} Sep 06 02:51:47.878710 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.878686 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"6d0e9272125c4630991e28ea4638602fd6deeb52921049279190e49ff562250b"} Sep 06 02:51:47.878824 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.878765 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"5274be01a4c2f4199ca42d6b7b5faa1fc055c05c4f7b3d2def44ca79e4fef310"} Sep 06 02:51:47.878935 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.878828 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"cc5238f61448b96114c0d9dd5fb8aa5376dcfa9601542495625765cb1dd50026"} Sep 06 02:51:47.878935 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.878876 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"318106b6c611f69f475e61d104fa062485ca4cfbe5fad816d8ab12d6aab6dcdd"} Sep 06 02:51:47.878935 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.878922 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"322f4545615ecbb269c103f9b0baad2fab1e9b98a5f20e0d8d7fed1abd43d141"} Sep 06 02:51:47.879085 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.878967 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"3d2df622da44f5bf5687ed0ef639586ad3b57a44b49fe988e6b44afef450dceb"} Sep 06 02:51:47.880387 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.880360 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-th72l" event={"ID":"255dee4d-6ebc-4384-9f76-d004209a3ac0","Type":"ContainerStarted","Data":"d82cc089eaef0fe7fa78f3d083bb7c784397ce34a7da249e5405e28ff0b6516f"} Sep 06 02:51:47.881974 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.881954 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" event={"ID":"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a","Type":"ContainerStarted","Data":"99c4fed3decf723fceab969ad0392ebc9172b8bcdc9466f75c7f1e47357aa1b5"} Sep 06 02:51:47.886663 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.886628 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rfg5q" podStartSLOduration=3.450852116 podStartE2EDuration="21.88661329s" totalImagesPullingTime="18.435761174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:47.886155203 +0000 UTC m=+22.713810626" watchObservedRunningTime="2026-09-06 02:51:47.88661329 +0000 UTC m=+22.714268711" Sep 06 02:51:47.930384 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.930296 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-49wmq" podStartSLOduration=7.287730613 podStartE2EDuration="21.930283716s" totalImagesPullingTime="14.642553103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:47.930003209 +0000 UTC m=+22.757658628" watchObservedRunningTime="2026-09-06 02:51:47.930283716 +0000 UTC m=+22.757939135" Sep 06 02:51:47.955016 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.954983 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t2whv" podStartSLOduration=3.505250218 podStartE2EDuration="21.95497266s" totalImagesPullingTime="18.449722442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:47.954856651 +0000 UTC m=+22.782512071" watchObservedRunningTime="2026-09-06 02:51:47.95497266 +0000 UTC m=+22.782628080" Sep 06 02:51:47.991244 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.991191 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-th72l" podStartSLOduration=3.5692575619999998 podStartE2EDuration="21.991174658s" totalImagesPullingTime="18.421917096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:47.970255234 +0000 UTC m=+22.797910654" watchObservedRunningTime="2026-09-06 02:51:47.991174658 +0000 UTC m=+22.818830108" Sep 06 02:51:47.991715 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:47.991685 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6sgk9" podStartSLOduration=3.483495083 podStartE2EDuration="21.991676504s" totalImagesPullingTime="18.508181421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:47.990993012 +0000 UTC m=+22.818648432" watchObservedRunningTime="2026-09-06 02:51:47.991676504 +0000 UTC m=+22.819331923" Sep 06 02:51:48.615034 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:48.615008 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 06 02:51:48.636657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:48.636574 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T02:51:48.615027653Z","UUID":"6d11c5f5-f123-4a11-a374-9fde058ca706","Handler":null,"Name":"","Endpoint":""} Sep 06 02:51:48.638189 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:48.638169 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 06 02:51:48.638301 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:48.638203 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 06 02:51:48.887252 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:48.887169 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" event={"ID":"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a","Type":"ContainerStarted","Data":"cc61ff36fe626f55adc569947fa633ee7940b64b254e16e9d22a3c382a248dcc"} Sep 06 02:51:48.888969 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:48.888941 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-klc96" event={"ID":"cd61d73b-ea22-4a94-ba88-ae9995156558","Type":"ContainerStarted","Data":"ece88a2601ba61a6e4ab498d24e6d073c02ddb1275ead8307b989f5ad3a7eade"} Sep 06 02:51:49.645161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:49.645136 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:49.645270 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:49.645135 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:49.645270 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:49.645238 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:49.645382 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:49.645145 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:49.645382 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:49.645363 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:49.645482 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:49.645412 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:49.893038 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:49.893006 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" event={"ID":"d33815e4-f2b2-4fe5-bd7e-d01c9d51469a","Type":"ContainerStarted","Data":"d22e4cdc3c85f9b0cff2697643414b3a4e53eb1f6a72c3d3754d3b87963502ea"} Sep 06 02:51:49.913644 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:49.913603 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8jr84" podStartSLOduration=3.345435288 podStartE2EDuration="23.913587215s" totalImagesPullingTime="20.568151927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:49.913272073 +0000 UTC m=+24.740927494" watchObservedRunningTime="2026-09-06 02:51:49.913587215 +0000 UTC m=+24.741242650" Sep 06 02:51:49.914173 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:49.914132 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-klc96" podStartSLOduration=5.466249883 podStartE2EDuration="23.914120857s" totalImagesPullingTime="18.447870974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:48.906142388 +0000 UTC m=+23.733797809" watchObservedRunningTime="2026-09-06 02:51:49.914120857 +0000 UTC m=+24.741776280" Sep 06 02:51:50.899995 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:50.899957 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"6184fdb856d4b327d62510e6317381979223311fa400f92d34aafbfdcd5d33ac"} Sep 06 02:51:51.645240 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:51.645205 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:51.645433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:51.645205 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:51.645433 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:51.645324 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:51.645558 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:51.645453 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:51.645558 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:51.645497 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:51.645660 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:51.645586 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:51.772013 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:51.771982 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:51.772682 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:51.772660 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:52.908385 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:52.908174 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" event={"ID":"fda1e155-d697-4ae3-9960-645af0f169e2","Type":"ContainerStarted","Data":"ddadef986c87adf2c49ec47e4e404e965af29d4f74350b8493015aa20a0d4f78"} Sep 06 02:51:52.909206 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:52.908425 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:52.910348 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:52.910325 2569 generic.go:356] "Generic (PLEG): container finished" podID="e35e2b20-920f-4d3b-858e-642153ec251a" containerID="7b384f6d9bf554dcf74f0b3b14a779d778710000f14e3019e50632fb633fa62b" exitCode=0 Sep 06 02:51:52.910449 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:52.910363 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm76v" event={"ID":"e35e2b20-920f-4d3b-858e-642153ec251a","Type":"ContainerDied","Data":"7b384f6d9bf554dcf74f0b3b14a779d778710000f14e3019e50632fb633fa62b"} Sep 06 02:51:52.923765 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:52.923744 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:52.942348 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:52.942297 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" podStartSLOduration=7.440755374 podStartE2EDuration="25.942280722s" totalImagesPullingTime="18.501525348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:51:52.942117443 +0000 UTC m=+27.769772863" watchObservedRunningTime="2026-09-06 02:51:52.942280722 +0000 UTC m=+27.769936143" Sep 06 02:51:53.645140 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.644992 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:53.645281 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.645019 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:53.645281 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:53.645229 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:53.645389 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.645069 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:53.645437 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:53.645423 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:53.645489 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:53.645314 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:53.914436 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.914320 2569 generic.go:356] "Generic (PLEG): container finished" podID="e35e2b20-920f-4d3b-858e-642153ec251a" containerID="c107ec1e2d39acc09d497a93f7e138b8c103853cecd6df8997a42b7003ee1da9" exitCode=0 Sep 06 02:51:53.914436 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.914397 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm76v" event={"ID":"e35e2b20-920f-4d3b-858e-642153ec251a","Type":"ContainerDied","Data":"c107ec1e2d39acc09d497a93f7e138b8c103853cecd6df8997a42b7003ee1da9"} Sep 06 02:51:53.915000 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.914944 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:53.915000 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.914998 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:53.929696 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.929677 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:51:53.973898 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.973875 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lskvr"] Sep 06 02:51:53.974000 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.973944 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:53.974039 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:53.974011 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:53.977264 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.977247 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9vd9k"] Sep 06 02:51:53.977356 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.977303 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:53.977399 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:53.977362 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:53.979715 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.979692 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ns26g"] Sep 06 02:51:53.979829 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:53.979792 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:53.979912 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:53.979896 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:54.129690 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:54.129655 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:54.129868 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:54.129822 2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 06 02:51:54.130321 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:54.130304 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-49wmq" Sep 06 02:51:54.918551 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:54.918465 2569 generic.go:356] "Generic (PLEG): container finished" podID="e35e2b20-920f-4d3b-858e-642153ec251a" containerID="64ff883ef43809fcf6b8161114c5c95166cd7075c9e31bfd8c426fccc50a7438" exitCode=0 Sep 06 02:51:54.918551 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:54.918530 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm76v" event={"ID":"e35e2b20-920f-4d3b-858e-642153ec251a","Type":"ContainerDied","Data":"64ff883ef43809fcf6b8161114c5c95166cd7075c9e31bfd8c426fccc50a7438"} Sep 06 02:51:55.646429 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:55.646392 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:55.646599 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:55.646497 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:55.646599 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:55.646536 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:55.646599 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:55.646534 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:55.646724 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:55.646611 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:55.646724 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:55.646694 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:57.644654 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:57.644623 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:57.645211 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:57.644623 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:57.645211 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:57.644760 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:57.645211 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:57.644796 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:57.645211 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:57.644887 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:57.645211 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:57.644946 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:59.345384 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.345214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:59.345384 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.345372 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:59.345976 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.345419 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:59.345976 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.345438 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret podName:5e9feeee-1c3b-4713-90e0-420ee974061f nodeName:}" failed. No retries permitted until 2026-09-06 02:52:31.345418388 +0000 UTC m=+66.173073789 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret") pod "global-pull-secret-syncer-lskvr" (UID: "5e9feeee-1c3b-4713-90e0-420ee974061f") : object "kube-system"/"original-pull-secret" not registered Sep 06 02:51:59.345976 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.345482 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:59.345976 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.345524 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs podName:8b26ede6-74e1-428a-b8bb-15ad8032380a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:31.345512748 +0000 UTC m=+66.173168146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs") pod "network-metrics-daemon-ns26g" (UID: "8b26ede6-74e1-428a-b8bb-15ad8032380a") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 06 02:51:59.547108 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.547020 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:59.547250 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.547161 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 06 02:51:59.547250 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.547177 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 06 02:51:59.547250 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.547187 2569 projected.go:196] Error preparing data for projected volume kube-api-access-ghw5p for pod openshift-network-diagnostics/network-check-target-9vd9k: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:59.547358 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.547259 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p podName:c3e1dd0b-14f8-49eb-a085-2883236a1af5 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:31.547246068 +0000 UTC m=+66.374901467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghw5p" (UniqueName: "kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p") pod "network-check-target-9vd9k" (UID: "c3e1dd0b-14f8-49eb-a085-2883236a1af5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 06 02:51:59.645109 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.645072 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:51:59.645275 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.645072 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:51:59.645275 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.645196 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ns26g" podUID="8b26ede6-74e1-428a-b8bb-15ad8032380a" Sep 06 02:51:59.645275 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.645075 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:51:59.645275 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.645262 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9vd9k" podUID="c3e1dd0b-14f8-49eb-a085-2883236a1af5" Sep 06 02:51:59.645456 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:51:59.645349 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lskvr" podUID="5e9feeee-1c3b-4713-90e0-420ee974061f" Sep 06 02:51:59.932304 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.932228 2569 generic.go:356] "Generic (PLEG): container finished" podID="e35e2b20-920f-4d3b-858e-642153ec251a" containerID="f97584a0fa1b56f3f30255ff7a19d9562969f638a3c8feadc61371a1df2868b1" exitCode=0 Sep 06 02:51:59.932304 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.932288 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm76v" event={"ID":"e35e2b20-920f-4d3b-858e-642153ec251a","Type":"ContainerDied","Data":"f97584a0fa1b56f3f30255ff7a19d9562969f638a3c8feadc61371a1df2868b1"} Sep 06 02:51:59.980251 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.980230 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-131.ec2.internal" event="NodeReady" Sep 06 02:51:59.980362 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:51:59.980327 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 06 02:52:00.017994 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.017969 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68dd5678f5-766jh"] Sep 06 02:52:00.055515 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.055488 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7fjgw"] Sep 06 02:52:00.055659 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.055626 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.058430 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.058404 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 06 02:52:00.058568 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.058404 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j9j4b\"" Sep 06 02:52:00.058568 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.058409 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 06 02:52:00.060114 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.060099 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 06 02:52:00.063422 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.063403 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 06 02:52:00.079517 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.079499 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f2b82"] Sep 06 02:52:00.079618 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.079605 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.082021 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.081978 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rx86k\"" Sep 06 02:52:00.082021 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.082005 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 06 02:52:00.082169 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.082047 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 06 02:52:00.092316 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.092298 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68dd5678f5-766jh"] Sep 06 02:52:00.092410 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.092325 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f2b82"] Sep 06 02:52:00.092410 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.092339 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7fjgw"] Sep 06 02:52:00.092486 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.092411 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f2b82" Sep 06 02:52:00.094860 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.094840 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-krjzb\"" Sep 06 02:52:00.094957 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.094905 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 06 02:52:00.094957 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.094934 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 06 02:52:00.095079 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.094966 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 06 02:52:00.150869 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.150844 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-trusted-ca\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.150969 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.150878 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.150969 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.150904 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-installation-pull-secrets\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.150969 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.150938 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-bound-sa-token\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.151063 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.150971 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t4tn\" (UniqueName: \"kubernetes.io/projected/e4f4929c-b0b9-497a-813f-567dded7f91c-kube-api-access-7t4tn\") pod \"ingress-canary-f2b82\" (UID: \"e4f4929c-b0b9-497a-813f-567dded7f91c\") " pod="openshift-ingress-canary/ingress-canary-f2b82" Sep 06 02:52:00.151102 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151071 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-config-volume\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.151131 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-image-registry-private-configuration\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.151160 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151149 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-tmp-dir\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.151190 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151180 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5aa6044-1c9b-4370-9f2f-301acb247e41-ca-trust-extracted\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.151225 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151201 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4f4929c-b0b9-497a-813f-567dded7f91c-cert\") pod \"ingress-canary-f2b82\" (UID: \"e4f4929c-b0b9-497a-813f-567dded7f91c\") " pod="openshift-ingress-canary/ingress-canary-f2b82" Sep 06 02:52:00.151259 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151228 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lshgx\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-kube-api-access-lshgx\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.151259 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151250 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.151315 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151267 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-certificates\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.151315 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.151287 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkl9\" (UniqueName: \"kubernetes.io/projected/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-kube-api-access-7qkl9\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.252600 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252537 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lshgx\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-kube-api-access-lshgx\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.252600 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252578 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.252600 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252594 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-certificates\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.252874 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252609 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkl9\" (UniqueName: \"kubernetes.io/projected/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-kube-api-access-7qkl9\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.252874 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252630 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-trusted-ca\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.252874 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.252715 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 02:52:00.252874 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.252735 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dd5678f5-766jh: secret "image-registry-tls" not found Sep 06 02:52:00.252874 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252753 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.252874 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.252816 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls podName:b5aa6044-1c9b-4370-9f2f-301acb247e41 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:00.752794252 +0000 UTC m=+35.580449669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls") pod "image-registry-68dd5678f5-766jh" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41") : secret "image-registry-tls" not found Sep 06 02:52:00.252874 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252842 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-installation-pull-secrets\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.252874 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252875 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-bound-sa-token\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.253258 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.252889 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 02:52:00.253258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252900 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t4tn\" (UniqueName: \"kubernetes.io/projected/e4f4929c-b0b9-497a-813f-567dded7f91c-kube-api-access-7t4tn\") pod \"ingress-canary-f2b82\" (UID: \"e4f4929c-b0b9-497a-813f-567dded7f91c\") " pod="openshift-ingress-canary/ingress-canary-f2b82" Sep 06 02:52:00.253258 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.252969 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls podName:b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab nodeName:}" failed. No retries permitted until 2026-09-06 02:52:00.752935274 +0000 UTC m=+35.580590676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls") pod "dns-default-7fjgw" (UID: "b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab") : secret "dns-default-metrics-tls" not found Sep 06 02:52:00.253258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.252993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-config-volume\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.253258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253059 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-image-registry-private-configuration\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.253258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253092 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-tmp-dir\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.253258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253146 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5aa6044-1c9b-4370-9f2f-301acb247e41-ca-trust-extracted\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.253258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253215 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4f4929c-b0b9-497a-813f-567dded7f91c-cert\") pod \"ingress-canary-f2b82\" (UID: \"e4f4929c-b0b9-497a-813f-567dded7f91c\") " pod="openshift-ingress-canary/ingress-canary-f2b82" Sep 06 02:52:00.253634 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253315 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-certificates\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.253634 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253429 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-tmp-dir\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.253634 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253500 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5aa6044-1c9b-4370-9f2f-301acb247e41-ca-trust-extracted\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.253634 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253617 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-config-volume\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.253855 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.253657 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-trusted-ca\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.256894 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.256875 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4f4929c-b0b9-497a-813f-567dded7f91c-cert\") pod \"ingress-canary-f2b82\" (UID: \"e4f4929c-b0b9-497a-813f-567dded7f91c\") " pod="openshift-ingress-canary/ingress-canary-f2b82" Sep 06 02:52:00.256986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.256923 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-image-registry-private-configuration\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.256986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.256923 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-installation-pull-secrets\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.265751 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.265713 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:00.266871 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.266853 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-bound-sa-token\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.267364 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.267345 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t4tn\" (UniqueName: \"kubernetes.io/projected/e4f4929c-b0b9-497a-813f-567dded7f91c-kube-api-access-7t4tn\") pod \"ingress-canary-f2b82\" (UID: \"e4f4929c-b0b9-497a-813f-567dded7f91c\") " pod="openshift-ingress-canary/ingress-canary-f2b82" Sep 06 02:52:00.267852 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.267837 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lshgx\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-kube-api-access-lshgx\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.267926 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.267911 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkl9\" (UniqueName: \"kubernetes.io/projected/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-kube-api-access-7qkl9\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.358606 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.358567 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:00.400765 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.400739 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f2b82" Sep 06 02:52:00.646976 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.646887 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:00.705926 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.705895 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f2b82"] Sep 06 02:52:00.709720 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:52:00.709691 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f4929c_b0b9_497a_813f_567dded7f91c.slice/crio-83954082747abe83c404889b29e3f5e9f7b1e5132b3020eca0939351e4405355 WatchSource:0}: Error finding container 83954082747abe83c404889b29e3f5e9f7b1e5132b3020eca0939351e4405355: Status 404 returned error can't find the container with id 83954082747abe83c404889b29e3f5e9f7b1e5132b3020eca0939351e4405355 Sep 06 02:52:00.713188 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.713163 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:00.756879 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.756853 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:00.756988 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.756889 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:00.757050 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.757016 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 02:52:00.757050 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.757037 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dd5678f5-766jh: secret "image-registry-tls" not found Sep 06 02:52:00.757355 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.757064 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 02:52:00.757355 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.757104 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls podName:b5aa6044-1c9b-4370-9f2f-301acb247e41 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:01.757083613 +0000 UTC m=+36.584739027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls") pod "image-registry-68dd5678f5-766jh" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41") : secret "image-registry-tls" not found Sep 06 02:52:00.757355 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:00.757124 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls podName:b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab nodeName:}" failed. No retries permitted until 2026-09-06 02:52:01.757114155 +0000 UTC m=+36.584769557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls") pod "dns-default-7fjgw" (UID: "b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab") : secret "dns-default-metrics-tls" not found Sep 06 02:52:00.771435 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.771403 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:00.938218 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.938142 2569 generic.go:356] "Generic (PLEG): container finished" podID="e35e2b20-920f-4d3b-858e-642153ec251a" containerID="0ae24f6606c6b8705184e3dec5e2131f806a78a05aed5fb78901eb1fa2091f80" exitCode=0 Sep 06 02:52:00.938338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.938230 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm76v" event={"ID":"e35e2b20-920f-4d3b-858e-642153ec251a","Type":"ContainerDied","Data":"0ae24f6606c6b8705184e3dec5e2131f806a78a05aed5fb78901eb1fa2091f80"} Sep 06 02:52:00.939705 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:00.939673 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f2b82" event={"ID":"e4f4929c-b0b9-497a-813f-567dded7f91c","Type":"ContainerStarted","Data":"83954082747abe83c404889b29e3f5e9f7b1e5132b3020eca0939351e4405355"} Sep 06 02:52:01.644660 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.644470 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:52:01.645355 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.644470 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:52:01.645355 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.644547 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:52:01.649366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.649173 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 06 02:52:01.649366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.649184 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 06 02:52:01.649366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.649213 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xvffp\"" Sep 06 02:52:01.649366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.649230 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 06 02:52:01.649366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.649245 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qvfrq\"" Sep 06 02:52:01.649366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.649190 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 06 02:52:01.764374 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.764340 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:01.764544 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.764471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:01.764544 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:01.764505 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 02:52:01.764656 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:01.764573 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls podName:b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab nodeName:}" failed. No retries permitted until 2026-09-06 02:52:03.764552903 +0000 UTC m=+38.592208318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls") pod "dns-default-7fjgw" (UID: "b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab") : secret "dns-default-metrics-tls" not found Sep 06 02:52:01.764656 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:01.764600 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 02:52:01.764656 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:01.764615 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dd5678f5-766jh: secret "image-registry-tls" not found Sep 06 02:52:01.764803 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:01.764665 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls podName:b5aa6044-1c9b-4370-9f2f-301acb247e41 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:03.764649623 +0000 UTC m=+38.592305036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls") pod "image-registry-68dd5678f5-766jh" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41") : secret "image-registry-tls" not found Sep 06 02:52:01.946456 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.946379 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm76v" event={"ID":"e35e2b20-920f-4d3b-858e-642153ec251a","Type":"ContainerStarted","Data":"46eb5ca03a7fba2b96cabc543f20946361af710f1dead4e063192ca6a76eca22"} Sep 06 02:52:01.969360 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:01.969312 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lm76v" podStartSLOduration=7.637235044 podStartE2EDuration="35.969296927s" totalImagesPullingTime="28.332061883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:52:01.968091669 +0000 UTC m=+36.795747088" watchObservedRunningTime="2026-09-06 02:52:01.969296927 +0000 UTC m=+36.796952343" Sep 06 02:52:02.090937 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:02.090904 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:02.191939 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:02.191901 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:03.780464 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:03.780374 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:03.780464 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:03.780428 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:03.780925 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:03.780522 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 02:52:03.780925 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:03.780544 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dd5678f5-766jh: secret "image-registry-tls" not found Sep 06 02:52:03.780925 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:03.780572 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 02:52:03.780925 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:03.780596 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls podName:b5aa6044-1c9b-4370-9f2f-301acb247e41 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:07.780582258 +0000 UTC m=+42.608237655 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls") pod "image-registry-68dd5678f5-766jh" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41") : secret "image-registry-tls" not found Sep 06 02:52:03.780925 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:03.780625 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls podName:b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab nodeName:}" failed. No retries permitted until 2026-09-06 02:52:07.780609317 +0000 UTC m=+42.608264738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls") pod "dns-default-7fjgw" (UID: "b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab") : secret "dns-default-metrics-tls" not found Sep 06 02:52:03.951576 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:03.951545 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f2b82" event={"ID":"e4f4929c-b0b9-497a-813f-567dded7f91c","Type":"ContainerStarted","Data":"7a0171b718528599dbcaefd1a5fc7dbfeaedf3b942c311b2d1b2eca627053952"} Sep 06 02:52:03.969598 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:03.969549 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f2b82" podStartSLOduration=1.7399126310000002 podStartE2EDuration="3.969536215s" totalImagesPullingTime="2.229623584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:52:03.969067448 +0000 UTC m=+38.796722877" watchObservedRunningTime="2026-09-06 02:52:03.969536215 +0000 UTC m=+38.797191634" Sep 06 02:52:05.132287 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:05.132254 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:05.205249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:05.205207 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:07.806996 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:07.806956 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:07.807366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:07.807006 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:07.807366 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:07.807111 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 02:52:07.807366 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:07.807165 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls podName:b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab nodeName:}" failed. No retries permitted until 2026-09-06 02:52:15.807150952 +0000 UTC m=+50.634806350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls") pod "dns-default-7fjgw" (UID: "b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab") : secret "dns-default-metrics-tls" not found Sep 06 02:52:07.807366 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:07.807116 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 02:52:07.807366 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:07.807204 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dd5678f5-766jh: secret "image-registry-tls" not found Sep 06 02:52:07.807366 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:07.807243 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls podName:b5aa6044-1c9b-4370-9f2f-301acb247e41 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:15.807232765 +0000 UTC m=+50.634888174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls") pod "image-registry-68dd5678f5-766jh" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41") : secret "image-registry-tls" not found Sep 06 02:52:09.543074 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:09.543036 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:09.636213 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:09.636186 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:10.549145 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:10.549110 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:10.640451 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:10.640419 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:12.724212 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:12.724181 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:12.796948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:12.796912 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:13.693529 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:13.693493 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:13.767658 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:13.767621 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:15.865767 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:15.865733 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:15.866241 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:15.865791 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:15.866241 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:15.865901 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 02:52:15.866241 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:15.865930 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dd5678f5-766jh: secret "image-registry-tls" not found Sep 06 02:52:15.866241 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:15.865910 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 02:52:15.866241 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:15.865994 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls podName:b5aa6044-1c9b-4370-9f2f-301acb247e41 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:31.865973589 +0000 UTC m=+66.693628992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls") pod "image-registry-68dd5678f5-766jh" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41") : secret "image-registry-tls" not found Sep 06 02:52:15.866241 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:15.866037 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls podName:b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab nodeName:}" failed. No retries permitted until 2026-09-06 02:52:31.866026382 +0000 UTC m=+66.693681779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls") pod "dns-default-7fjgw" (UID: "b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab") : secret "dns-default-metrics-tls" not found Sep 06 02:52:19.162005 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:19.161967 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:19.656366 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:19.656327 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:19.761151 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:19.761117 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:19.862459 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:19.862429 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:19.960816 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:19.960731 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:20.058538 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:20.058506 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:23.681535 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:23.681460 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:25.930371 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:25.930344 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cd8jj" Sep 06 02:52:26.106624 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.106584 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:26.205378 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.205272 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:26.509893 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.509855 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:26.607246 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.607186 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:26.765444 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.765367 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:26.879784 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.879731 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c55c8c9b8-fjdpz"] Sep 06 02:52:26.882677 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.882640 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:26.883113 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.883097 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:26.886797 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.886759 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 06 02:52:26.886797 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.886791 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 06 02:52:26.886962 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.886762 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bmtkd\"" Sep 06 02:52:26.886962 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.886815 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 06 02:52:26.887700 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.887685 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 06 02:52:26.887748 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.887714 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 06 02:52:26.887806 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.887717 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 06 02:52:26.909875 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:26.909852 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c55c8c9b8-fjdpz"] Sep 06 02:52:27.045817 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.045728 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-default-certificate\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.045817 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.045767 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.046188 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.045838 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-stats-auth\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.046188 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.045865 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmdcr\" (UniqueName: \"kubernetes.io/projected/5c084985-b273-4d55-90b6-79222607449a-kube-api-access-gmdcr\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.046188 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.045919 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.146962 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.146932 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.147116 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.146992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-default-certificate\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.147116 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.147019 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.147116 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.147042 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-stats-auth\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.147116 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.147057 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmdcr\" (UniqueName: \"kubernetes.io/projected/5c084985-b273-4d55-90b6-79222607449a-kube-api-access-gmdcr\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.147116 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:27.147110 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:27.647088985 +0000 UTC m=+62.474744383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : configmap references non-existent config key: service-ca.crt Sep 06 02:52:27.147334 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:27.147159 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 02:52:27.147334 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:27.147231 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:27.647216042 +0000 UTC m=+62.474871440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : secret "router-metrics-certs-default" not found Sep 06 02:52:27.150395 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.150369 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-stats-auth\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.150501 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.150484 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-default-certificate\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.165071 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.165046 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmdcr\" (UniqueName: \"kubernetes.io/projected/5c084985-b273-4d55-90b6-79222607449a-kube-api-access-gmdcr\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.294112 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.294086 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:27.404173 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.404075 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:27.651572 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.651542 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.651728 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:27.651598 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:27.651728 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:27.651679 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 02:52:27.651728 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:27.651696 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:28.65168385 +0000 UTC m=+63.479339249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : configmap references non-existent config key: service-ca.crt Sep 06 02:52:27.651865 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:27.651735 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:28.651722141 +0000 UTC m=+63.479377540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : secret "router-metrics-certs-default" not found Sep 06 02:52:28.659045 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:28.659002 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:28.659436 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:28.659073 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:28.659436 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:28.659150 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 02:52:28.659436 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:28.659219 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:30.659204452 +0000 UTC m=+65.486859849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : secret "router-metrics-certs-default" not found Sep 06 02:52:28.659436 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:28.659232 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:30.659225889 +0000 UTC m=+65.486881286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : configmap references non-existent config key: service-ca.crt Sep 06 02:52:29.776264 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:29.776226 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:29.851176 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:29.851146 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:30.675873 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:30.675838 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:30.676059 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:30.675911 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:30.676059 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:30.676008 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:34.675989019 +0000 UTC m=+69.503644416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : configmap references non-existent config key: service-ca.crt Sep 06 02:52:30.676059 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:30.676021 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 02:52:30.676188 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:30.676067 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:34.676055773 +0000 UTC m=+69.503711171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : secret "router-metrics-certs-default" not found Sep 06 02:52:31.380541 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.380487 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:52:31.380541 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.380546 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:52:31.383553 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.383534 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 06 02:52:31.383605 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.383541 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 06 02:52:31.390764 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:31.390741 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 06 02:52:31.390880 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:31.390819 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs podName:8b26ede6-74e1-428a-b8bb-15ad8032380a nodeName:}" failed. No retries permitted until 2026-09-06 02:53:35.390800441 +0000 UTC m=+130.218455854 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs") pod "network-metrics-daemon-ns26g" (UID: "8b26ede6-74e1-428a-b8bb-15ad8032380a") : secret "metrics-daemon-secret" not found Sep 06 02:52:31.392863 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.392844 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5e9feeee-1c3b-4713-90e0-420ee974061f-original-pull-secret\") pod \"global-pull-secret-syncer-lskvr\" (UID: \"5e9feeee-1c3b-4713-90e0-420ee974061f\") " pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:52:31.581873 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.581838 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:52:31.584799 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.584763 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 06 02:52:31.595581 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.595562 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 06 02:52:31.606159 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.606130 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghw5p\" (UniqueName: \"kubernetes.io/projected/c3e1dd0b-14f8-49eb-a085-2883236a1af5-kube-api-access-ghw5p\") pod \"network-check-target-9vd9k\" (UID: \"c3e1dd0b-14f8-49eb-a085-2883236a1af5\") " pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:52:31.664205 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.664138 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lskvr" Sep 06 02:52:31.673589 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.673563 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xvffp\"" Sep 06 02:52:31.681088 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.681067 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:52:31.883877 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.883843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:52:31.884052 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.883893 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:52:31.884052 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:31.883993 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 06 02:52:31.884052 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:31.884007 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 06 02:52:31.884052 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:31.884015 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dd5678f5-766jh: secret "image-registry-tls" not found Sep 06 02:52:31.884198 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:31.884066 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls podName:b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab nodeName:}" failed. No retries permitted until 2026-09-06 02:53:03.884051789 +0000 UTC m=+98.711707187 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls") pod "dns-default-7fjgw" (UID: "b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab") : secret "dns-default-metrics-tls" not found Sep 06 02:52:31.884198 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:31.884080 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls podName:b5aa6044-1c9b-4370-9f2f-301acb247e41 nodeName:}" failed. No retries permitted until 2026-09-06 02:53:03.88407261 +0000 UTC m=+98.711728008 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls") pod "image-registry-68dd5678f5-766jh" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41") : secret "image-registry-tls" not found Sep 06 02:52:31.936271 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.936195 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lskvr"] Sep 06 02:52:31.939943 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:52:31.939913 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e9feeee_1c3b_4713_90e0_420ee974061f.slice/crio-d3f5f642d0716899e05a428c1888c57149c1ac7d4cdfd3a044240a3eb3adee23 WatchSource:0}: Error finding container d3f5f642d0716899e05a428c1888c57149c1ac7d4cdfd3a044240a3eb3adee23: Status 404 returned error can't find the container with id d3f5f642d0716899e05a428c1888c57149c1ac7d4cdfd3a044240a3eb3adee23 Sep 06 02:52:31.954508 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:31.954485 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9vd9k"] Sep 06 02:52:31.957400 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:52:31.957375 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e1dd0b_14f8_49eb_a085_2883236a1af5.slice/crio-0b9f81510d73ffcc24726b6dc06510fd1d58387ff751b08c64db32472634e4a1 WatchSource:0}: Error finding container 0b9f81510d73ffcc24726b6dc06510fd1d58387ff751b08c64db32472634e4a1: Status 404 returned error can't find the container with id 0b9f81510d73ffcc24726b6dc06510fd1d58387ff751b08c64db32472634e4a1 Sep 06 02:52:32.018480 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:32.018450 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lskvr" event={"ID":"5e9feeee-1c3b-4713-90e0-420ee974061f","Type":"ContainerStarted","Data":"d3f5f642d0716899e05a428c1888c57149c1ac7d4cdfd3a044240a3eb3adee23"} Sep 06 02:52:32.019514 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:32.019494 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9vd9k" event={"ID":"c3e1dd0b-14f8-49eb-a085-2883236a1af5","Type":"ContainerStarted","Data":"0b9f81510d73ffcc24726b6dc06510fd1d58387ff751b08c64db32472634e4a1"} Sep 06 02:52:32.952505 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:32.952440 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:33.052400 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:33.052306 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:34.692897 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.692853 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:34.706834 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.706802 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:34.707002 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.706903 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:34.707002 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:34.706987 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:42.706963993 +0000 UTC m=+77.534619395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : configmap references non-existent config key: service-ca.crt Sep 06 02:52:34.707111 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:34.707050 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 02:52:34.707111 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:34.707102 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:42.707088701 +0000 UTC m=+77.534744099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : secret "router-metrics-certs-default" not found Sep 06 02:52:34.821007 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.820963 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:34.885625 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.885585 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6hbvb"] Sep 06 02:52:34.887792 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.887752 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:34.891948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.891926 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 06 02:52:34.892867 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.892716 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 06 02:52:34.892867 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.892732 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 06 02:52:34.893137 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.893120 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2fr68\"" Sep 06 02:52:34.893308 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.893294 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 06 02:52:34.905704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.905673 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hbvb"] Sep 06 02:52:34.961134 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:34.961043 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:35.009108 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.009067 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqnwd\" (UniqueName: \"kubernetes.io/projected/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-api-access-lqnwd\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.009286 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.009185 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8d3bb5d-8dd7-43a2-b136-46aa93879681-crio-socket\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.009286 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.009249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.009415 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.009292 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.009415 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.009369 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8d3bb5d-8dd7-43a2-b136-46aa93879681-data-volume\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.110261 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.110221 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8d3bb5d-8dd7-43a2-b136-46aa93879681-crio-socket\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.110433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.110339 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.110433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.110379 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.110433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.110412 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8d3bb5d-8dd7-43a2-b136-46aa93879681-data-volume\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.110433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.110347 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8d3bb5d-8dd7-43a2-b136-46aa93879681-crio-socket\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.110633 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.110447 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqnwd\" (UniqueName: \"kubernetes.io/projected/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-api-access-lqnwd\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.110633 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:35.110460 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 02:52:35.110633 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:35.110535 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:35.610515099 +0000 UTC m=+70.438170520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : configmap "kube-rbac-proxy" not found Sep 06 02:52:35.110633 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:35.110536 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 02:52:35.110633 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:35.110593 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:35.61057656 +0000 UTC m=+70.438231963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : secret "insights-runtime-extractor-tls" not found Sep 06 02:52:35.110913 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.110745 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8d3bb5d-8dd7-43a2-b136-46aa93879681-data-volume\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.122123 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.122100 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqnwd\" (UniqueName: \"kubernetes.io/projected/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-api-access-lqnwd\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.128153 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.128098 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:35.219623 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.219511 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:35.321351 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.321315 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:35.615460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.615414 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.615655 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.615471 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:35.615655 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:35.615546 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 02:52:35.615655 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:35.615651 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 02:52:35.615835 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:35.615698 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:36.615669137 +0000 UTC m=+71.443324539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : configmap "kube-rbac-proxy" not found Sep 06 02:52:35.615835 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:35.615727 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:36.615717016 +0000 UTC m=+71.443372420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : secret "insights-runtime-extractor-tls" not found Sep 06 02:52:35.752898 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.752863 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:35.852219 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:35.852182 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:36.208983 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:36.208914 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:36.311502 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:36.311427 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:36.453425 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:36.453341 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:36.553362 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:36.553330 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:36.624048 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:36.624018 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:36.624048 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:36.624051 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:36.624211 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:36.624132 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 02:52:36.624211 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:36.624150 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 02:52:36.624211 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:36.624197 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:38.624177757 +0000 UTC m=+73.451833156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : configmap "kube-rbac-proxy" not found Sep 06 02:52:36.624317 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:36.624268 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:38.624246047 +0000 UTC m=+73.451901457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : secret "insights-runtime-extractor-tls" not found Sep 06 02:52:36.808899 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:36.808865 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:36.911067 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:36.911034 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:37.029965 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.029944 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-th72l_255dee4d-6ebc-4384-9f76-d004209a3ac0/dns-node-resolver/0.log" Sep 06 02:52:37.034000 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.033971 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lskvr" event={"ID":"5e9feeee-1c3b-4713-90e0-420ee974061f","Type":"ContainerStarted","Data":"275c7d42ce9164a1c59cd13dfa25237447510af602d28947ac2b9c845f93d280"} Sep 06 02:52:37.035389 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.035358 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9vd9k" event={"ID":"c3e1dd0b-14f8-49eb-a085-2883236a1af5","Type":"ContainerStarted","Data":"72fb2dac9e0f7325a873024b916e681c483811c70fe6d836f794cfa02b6faeff"} Sep 06 02:52:37.035506 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.035492 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:52:37.049706 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.049665 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lskvr" podStartSLOduration=66.800024854 podStartE2EDuration="1m11.049653409s" totalImagesPullingTime="4.249628555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:52:37.048607292 +0000 UTC m=+71.876262713" watchObservedRunningTime="2026-09-06 02:52:37.049653409 +0000 UTC m=+71.877308829" Sep 06 02:52:37.064907 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.064841 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9vd9k" podStartSLOduration=66.835845041 podStartE2EDuration="1m11.064830538s" totalImagesPullingTime="4.228985497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:52:37.064306517 +0000 UTC m=+71.891961964" watchObservedRunningTime="2026-09-06 02:52:37.064830538 +0000 UTC m=+71.892485959" Sep 06 02:52:37.430095 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.430015 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t2whv_74b8b94d-ef8b-4297-9c82-ba364256fa95/node-ca/0.log" Sep 06 02:52:37.807711 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.807683 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:37.879111 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:37.879078 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:38.098399 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:38.098324 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:38.161688 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:38.161656 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:38.430797 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:38.430685 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f2b82_e4f4929c-b0b9-497a-813f-567dded7f91c/serve-healthcheck-canary/0.log" Sep 06 02:52:38.638544 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:38.638496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:38.638544 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:38.638545 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:38.638803 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:38.638628 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 02:52:38.638803 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:38.638685 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:42.638671087 +0000 UTC m=+77.466326486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : configmap "kube-rbac-proxy" not found Sep 06 02:52:38.638803 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:38.638725 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 02:52:38.638803 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:38.638768 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:42.638757734 +0000 UTC m=+77.466413132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : secret "insights-runtime-extractor-tls" not found Sep 06 02:52:39.207310 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:39.207274 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:41.887009 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:41.886970 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:41.998045 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:41.998007 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:42.253374 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:42.253344 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:42.347670 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:42.347639 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:42.585205 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:42.585124 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:42.667664 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:42.667626 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:42.667664 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:42.667667 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:42.667938 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:42.667768 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 02:52:42.667938 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:42.667765 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 06 02:52:42.667938 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:42.667842 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:50.6678276 +0000 UTC m=+85.495482998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : secret "insights-runtime-extractor-tls" not found Sep 06 02:52:42.667938 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:42.667856 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:52:50.667849467 +0000 UTC m=+85.495504865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : configmap "kube-rbac-proxy" not found Sep 06 02:52:42.768719 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:42.768684 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:42.768885 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:42.768742 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:42.768885 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:42.768878 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:58.768864112 +0000 UTC m=+93.596519510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : configmap references non-existent config key: service-ca.crt Sep 06 02:52:42.769014 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:42.768890 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 06 02:52:42.769014 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:42.768955 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs podName:5c084985-b273-4d55-90b6-79222607449a nodeName:}" failed. No retries permitted until 2026-09-06 02:52:58.76893684 +0000 UTC m=+93.596592238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs") pod "router-default-c55c8c9b8-fjdpz" (UID: "5c084985-b273-4d55-90b6-79222607449a") : secret "router-metrics-certs-default" not found Sep 06 02:52:43.590211 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:43.590178 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:43.810830 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:43.810760 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:43.992681 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:43.992654 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:44.177670 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:44.177635 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:44.386067 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:44.385974 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:44.768596 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:44.768558 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:45.171463 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:45.171367 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:45.591948 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:45.591918 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:45.771992 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:45.771948 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:46.142957 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:46.142922 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:46.367541 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:46.367498 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:46.572907 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:46.572868 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:46.781234 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:46.781202 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:47.185445 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:47.185409 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:47.568013 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:47.567979 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:48.047182 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:48.047053 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:48.171022 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:48.170986 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:48.339758 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:48.339673 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:48.574003 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:48.573966 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:48.976085 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:48.976053 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:49.367074 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:49.367041 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:49.773677 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:49.773643 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:49.971117 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:49.971092 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:50.581538 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:50.581502 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:50.723313 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:50.723274 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:50.733266 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:50.733243 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:50.733313 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:50.733275 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:50.733391 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:50.733379 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 06 02:52:50.733446 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:52:50.733437 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls podName:c8d3bb5d-8dd7-43a2-b136-46aa93879681 nodeName:}" failed. No retries permitted until 2026-09-06 02:53:06.733424655 +0000 UTC m=+101.561080053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hbvb" (UID: "c8d3bb5d-8dd7-43a2-b136-46aa93879681") : secret "insights-runtime-extractor-tls" not found Sep 06 02:52:50.733755 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:50.733735 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8d3bb5d-8dd7-43a2-b136-46aa93879681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:52:50.995131 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:50.995093 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:51.403081 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:51.403000 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:51.774343 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:51.774301 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:51.976693 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:51.976665 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:52.371756 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:52.371724 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:52.577045 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:52.577005 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:54.197290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:54.197257 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:54.298753 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:54.298718 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:54.357142 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:54.357116 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:54.531609 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:54.531581 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:54.681641 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:54.681612 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:54.745726 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:54.745693 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:55.282792 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:55.282745 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:55.351308 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:55.351276 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:55.503616 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:55.503587 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:55.570157 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:55.570097 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:55.878394 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:55.878316 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:56.078242 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:56.078209 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:56.262687 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:56.262658 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:57.312923 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:57.312885 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:57.413014 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:57.412987 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:57.733256 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:57.733173 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:57.798245 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:57.798218 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:52:58.791030 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:58.790986 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:58.791534 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:58.791065 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:58.791749 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:58.791727 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c084985-b273-4d55-90b6-79222607449a-service-ca-bundle\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:58.793440 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:58.793420 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c084985-b273-4d55-90b6-79222607449a-metrics-certs\") pod \"router-default-c55c8c9b8-fjdpz\" (UID: \"5c084985-b273-4d55-90b6-79222607449a\") " pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:58.992463 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:58.992410 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:52:59.262791 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:52:59.262747 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c55c8c9b8-fjdpz"] Sep 06 02:52:59.266114 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:52:59.266080 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c084985_b273_4d55_90b6_79222607449a.slice/crio-5c79f34b2af29ea9012e4efd71c23a4c8589b2c0497bf8cf39a2cdd798b42742 WatchSource:0}: Error finding container 5c79f34b2af29ea9012e4efd71c23a4c8589b2c0497bf8cf39a2cdd798b42742: Status 404 returned error can't find the container with id 5c79f34b2af29ea9012e4efd71c23a4c8589b2c0497bf8cf39a2cdd798b42742 Sep 06 02:53:00.090050 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:00.090020 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" event={"ID":"5c084985-b273-4d55-90b6-79222607449a","Type":"ContainerStarted","Data":"392ad2414c373728e9be21ede75e63caf939c5bccee0d4c3dfa9faca5f22fb79"} Sep 06 02:53:00.090408 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:00.090065 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" event={"ID":"5c084985-b273-4d55-90b6-79222607449a","Type":"ContainerStarted","Data":"5c79f34b2af29ea9012e4efd71c23a4c8589b2c0497bf8cf39a2cdd798b42742"} Sep 06 02:53:00.115687 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:00.115646 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" podStartSLOduration=34.115632351 podStartE2EDuration="34.115632351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:00.115313206 +0000 UTC m=+94.942968625" watchObservedRunningTime="2026-09-06 02:53:00.115632351 +0000 UTC m=+94.943287782" Sep 06 02:53:00.993212 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:00.993179 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:53:00.995720 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:00.995696 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:53:01.092214 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:01.092189 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:53:01.093207 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:01.093188 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c55c8c9b8-fjdpz" Sep 06 02:53:01.893238 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:01.893203 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:01.995753 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:01.995719 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:02.123965 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:02.123928 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:02.654740 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:02.654703 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:02.754374 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:02.754345 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:03.930147 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:03.930073 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:53:03.930456 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:03.930154 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:53:03.932097 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:03.932077 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab-metrics-tls\") pod \"dns-default-7fjgw\" (UID: \"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab\") " pod="openshift-dns/dns-default-7fjgw" Sep 06 02:53:03.932272 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:03.932255 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"image-registry-68dd5678f5-766jh\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:53:03.970316 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:03.970290 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j9j4b\"" Sep 06 02:53:03.975997 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:03.975975 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:53:03.991194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:03.991169 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rx86k\"" Sep 06 02:53:03.998322 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:03.998300 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7fjgw" Sep 06 02:53:04.107309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.107280 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm"] Sep 06 02:53:04.110300 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.110284 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.114822 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.114800 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 06 02:53:04.114945 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.114913 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 06 02:53:04.114945 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.114923 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 06 02:53:04.116562 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.116541 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 06 02:53:04.160632 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.160607 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm"] Sep 06 02:53:04.203393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.203323 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-pg9zc"] Sep 06 02:53:04.206057 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.206042 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6596cd87f9-6htd4"] Sep 06 02:53:04.206181 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.206164 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-pg9zc" Sep 06 02:53:04.208562 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.208542 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.226915 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.226900 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 06 02:53:04.227733 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.227721 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 06 02:53:04.233004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.232982 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/32284e8e-7a3e-40e7-a879-982e5be172d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.233090 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.233011 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d48m2\" (UniqueName: \"kubernetes.io/projected/32284e8e-7a3e-40e7-a879-982e5be172d6-kube-api-access-d48m2\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.233090 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.233035 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32284e8e-7a3e-40e7-a879-982e5be172d6-tmp\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.250440 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.250412 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 06 02:53:04.250566 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.250440 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cvm49\"" Sep 06 02:53:04.250566 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.250487 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 06 02:53:04.250566 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.250506 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 06 02:53:04.250566 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.250440 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 06 02:53:04.251436 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.251421 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nj25n\"" Sep 06 02:53:04.251499 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.251472 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-pg9zc"] Sep 06 02:53:04.255621 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.255607 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 06 02:53:04.287732 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.287706 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6596cd87f9-6htd4"] Sep 06 02:53:04.316875 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.316843 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68dd5678f5-766jh"] Sep 06 02:53:04.317994 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:04.317973 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64fc2f4_2ab0_4e22_9219_ea71b8dbb1ab.slice/crio-baea86d5d1943faf2a575baf232c27b72fde37b3be12250324d4852de9c37091 WatchSource:0}: Error finding container baea86d5d1943faf2a575baf232c27b72fde37b3be12250324d4852de9c37091: Status 404 returned error can't find the container with id baea86d5d1943faf2a575baf232c27b72fde37b3be12250324d4852de9c37091 Sep 06 02:53:04.318618 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:04.318586 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5aa6044_1c9b_4370_9f2f_301acb247e41.slice/crio-daee62614409bc9f411d4e9c5a2ae362716e24e5df393768a18dcae4ec5dfac4 WatchSource:0}: Error finding container daee62614409bc9f411d4e9c5a2ae362716e24e5df393768a18dcae4ec5dfac4: Status 404 returned error can't find the container with id daee62614409bc9f411d4e9c5a2ae362716e24e5df393768a18dcae4ec5dfac4 Sep 06 02:53:04.318704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.318626 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7fjgw"] Sep 06 02:53:04.334243 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334225 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qptgn\" (UniqueName: \"kubernetes.io/projected/2451bbe3-0455-439d-a89d-39a3c8273fc5-kube-api-access-qptgn\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.334290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334258 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-config\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.334290 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334279 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-service-ca\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.334362 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334332 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d48m2\" (UniqueName: \"kubernetes.io/projected/32284e8e-7a3e-40e7-a879-982e5be172d6-kube-api-access-d48m2\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.334392 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334371 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/32284e8e-7a3e-40e7-a879-982e5be172d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.334425 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334396 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvwjl\" (UniqueName: \"kubernetes.io/projected/0ea0c2c3-2e58-4d4a-a061-6f831544d122-kube-api-access-vvwjl\") pod \"downloads-85d98c998f-pg9zc\" (UID: \"0ea0c2c3-2e58-4d4a-a061-6f831544d122\") " pod="openshift-console/downloads-85d98c998f-pg9zc" Sep 06 02:53:04.334460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334420 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-oauth-serving-cert\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.334460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334444 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-oauth-config\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.334538 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334511 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32284e8e-7a3e-40e7-a879-982e5be172d6-tmp\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.334632 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334611 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-serving-cert\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.334864 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.334845 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32284e8e-7a3e-40e7-a879-982e5be172d6-tmp\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.336924 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.336905 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/32284e8e-7a3e-40e7-a879-982e5be172d6-klusterlet-config\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.359267 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.359241 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:04.364579 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.364556 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d48m2\" (UniqueName: \"kubernetes.io/projected/32284e8e-7a3e-40e7-a879-982e5be172d6-kube-api-access-d48m2\") pod \"klusterlet-addon-workmgr-6fc545fd6b-wqfjm\" (UID: \"32284e8e-7a3e-40e7-a879-982e5be172d6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.419434 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.419396 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:04.435332 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.435304 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvwjl\" (UniqueName: \"kubernetes.io/projected/0ea0c2c3-2e58-4d4a-a061-6f831544d122-kube-api-access-vvwjl\") pod \"downloads-85d98c998f-pg9zc\" (UID: \"0ea0c2c3-2e58-4d4a-a061-6f831544d122\") " pod="openshift-console/downloads-85d98c998f-pg9zc" Sep 06 02:53:04.435332 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.435334 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-oauth-serving-cert\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.435497 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.435358 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-oauth-config\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.435497 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.435448 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-serving-cert\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.435600 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.435525 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptgn\" (UniqueName: \"kubernetes.io/projected/2451bbe3-0455-439d-a89d-39a3c8273fc5-kube-api-access-qptgn\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.435600 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.435569 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-config\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.435698 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.435603 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-service-ca\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.436408 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.436382 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-service-ca\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.436525 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.436450 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-config\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.436719 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.436690 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-oauth-serving-cert\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.437889 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.437859 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-oauth-config\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.437996 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.437975 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-serving-cert\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.453956 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.453859 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qptgn\" (UniqueName: \"kubernetes.io/projected/2451bbe3-0455-439d-a89d-39a3c8273fc5-kube-api-access-qptgn\") pod \"console-6596cd87f9-6htd4\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.455605 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.455580 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvwjl\" (UniqueName: \"kubernetes.io/projected/0ea0c2c3-2e58-4d4a-a061-6f831544d122-kube-api-access-vvwjl\") pod \"downloads-85d98c998f-pg9zc\" (UID: \"0ea0c2c3-2e58-4d4a-a061-6f831544d122\") " pod="openshift-console/downloads-85d98c998f-pg9zc" Sep 06 02:53:04.494615 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.492821 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:04.515869 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.515842 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-pg9zc" Sep 06 02:53:04.519818 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.519792 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:04.589782 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.589719 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:04.693001 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.692967 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm"] Sep 06 02:53:04.696330 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:04.696277 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32284e8e_7a3e_40e7_a879_982e5be172d6.slice/crio-4d34e9b169e5630e5a2146d080699c0769d35cbb7783e4d5804bbe78d2fdd665 WatchSource:0}: Error finding container 4d34e9b169e5630e5a2146d080699c0769d35cbb7783e4d5804bbe78d2fdd665: Status 404 returned error can't find the container with id 4d34e9b169e5630e5a2146d080699c0769d35cbb7783e4d5804bbe78d2fdd665 Sep 06 02:53:04.696330 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.696284 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:04.802266 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.802230 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-pg9zc"] Sep 06 02:53:04.806401 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.806314 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6596cd87f9-6htd4"] Sep 06 02:53:04.811000 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:04.810972 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2451bbe3_0455_439d_a89d_39a3c8273fc5.slice/crio-5e9f0972a4c5da211ddbc32b6a43467546620a12eea7d4ac59261e28b0e219f5 WatchSource:0}: Error finding container 5e9f0972a4c5da211ddbc32b6a43467546620a12eea7d4ac59261e28b0e219f5: Status 404 returned error can't find the container with id 5e9f0972a4c5da211ddbc32b6a43467546620a12eea7d4ac59261e28b0e219f5 Sep 06 02:53:04.961562 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:04.961525 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:05.053083 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.053005 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:05.104821 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.104785 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" event={"ID":"32284e8e-7a3e-40e7-a879-982e5be172d6","Type":"ContainerStarted","Data":"4d34e9b169e5630e5a2146d080699c0769d35cbb7783e4d5804bbe78d2fdd665"} Sep 06 02:53:05.106258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.106220 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fjgw" event={"ID":"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab","Type":"ContainerStarted","Data":"baea86d5d1943faf2a575baf232c27b72fde37b3be12250324d4852de9c37091"} Sep 06 02:53:05.107764 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.107739 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" event={"ID":"b5aa6044-1c9b-4370-9f2f-301acb247e41","Type":"ContainerStarted","Data":"e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12"} Sep 06 02:53:05.107906 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.107890 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:53:05.107970 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.107927 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" event={"ID":"b5aa6044-1c9b-4370-9f2f-301acb247e41","Type":"ContainerStarted","Data":"daee62614409bc9f411d4e9c5a2ae362716e24e5df393768a18dcae4ec5dfac4"} Sep 06 02:53:05.108972 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.108943 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-pg9zc" event={"ID":"0ea0c2c3-2e58-4d4a-a061-6f831544d122","Type":"ContainerStarted","Data":"f81d3f5be259a850bc0182cbd7b93ab5b767fabab2754fae83562dd4adbdfe3f"} Sep 06 02:53:05.110265 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.110246 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6596cd87f9-6htd4" event={"ID":"2451bbe3-0455-439d-a89d-39a3c8273fc5","Type":"ContainerStarted","Data":"5e9f0972a4c5da211ddbc32b6a43467546620a12eea7d4ac59261e28b0e219f5"} Sep 06 02:53:05.133221 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:05.133174 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" podStartSLOduration=98.13315824 podStartE2EDuration="1m38.13315824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:05.131588889 +0000 UTC m=+99.959244311" watchObservedRunningTime="2026-09-06 02:53:05.13315824 +0000 UTC m=+99.960813663" Sep 06 02:53:06.757961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:06.757918 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:53:06.773420 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:06.773389 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8d3bb5d-8dd7-43a2-b136-46aa93879681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hbvb\" (UID: \"c8d3bb5d-8dd7-43a2-b136-46aa93879681\") " pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:53:06.953034 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:06.952981 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:06.998693 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:06.998662 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hbvb" Sep 06 02:53:07.052339 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:07.052287 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:07.126837 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:07.125902 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fjgw" event={"ID":"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab","Type":"ContainerStarted","Data":"1776398fa63d4ed4f962b6880441139f45a8f1a1715be37541833348068feaef"} Sep 06 02:53:07.126837 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:07.126003 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7fjgw" event={"ID":"b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab","Type":"ContainerStarted","Data":"a7649b8bd23c80b714e5a0ca8d7ab6e2855a4cc8b8f6c17bece4c9e96212677f"} Sep 06 02:53:07.126837 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:07.126754 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7fjgw" Sep 06 02:53:07.150240 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:07.150209 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:08.040239 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:08.040207 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9vd9k" Sep 06 02:53:08.058006 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:08.057875 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7fjgw" podStartSLOduration=66.161138113 podStartE2EDuration="1m8.057853414s" totalImagesPullingTime="1.896715301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:07.146558443 +0000 UTC m=+101.974213867" watchObservedRunningTime="2026-09-06 02:53:08.057853414 +0000 UTC m=+102.885508837" Sep 06 02:53:08.787340 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:08.787291 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:08.887723 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:08.887689 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:10.915037 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:10.914817 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:11.013432 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.013357 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:11.099635 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.099609 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hbvb"] Sep 06 02:53:11.102764 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:11.102734 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d3bb5d_8dd7_43a2_b136_46aa93879681.slice/crio-00c8605724cc10e70e67d7b9af856744184043426614ee5b4e2675c61f585220 WatchSource:0}: Error finding container 00c8605724cc10e70e67d7b9af856744184043426614ee5b4e2675c61f585220: Status 404 returned error can't find the container with id 00c8605724cc10e70e67d7b9af856744184043426614ee5b4e2675c61f585220 Sep 06 02:53:11.141021 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.140989 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hbvb" event={"ID":"c8d3bb5d-8dd7-43a2-b136-46aa93879681","Type":"ContainerStarted","Data":"00c8605724cc10e70e67d7b9af856744184043426614ee5b4e2675c61f585220"} Sep 06 02:53:11.142977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.142951 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6596cd87f9-6htd4" event={"ID":"2451bbe3-0455-439d-a89d-39a3c8273fc5","Type":"ContainerStarted","Data":"c37343562c5e77fc905ccaf8113fb82c2a62b05819e09176345e4feb288a467a"} Sep 06 02:53:11.145049 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.145024 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" event={"ID":"32284e8e-7a3e-40e7-a879-982e5be172d6","Type":"ContainerStarted","Data":"3c0827c889b36a9c4cb1c45958526c9f2a51e58e239da7e084aaca9ed9a4d1b0"} Sep 06 02:53:11.145422 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.145402 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:11.147054 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.147034 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" Sep 06 02:53:11.164359 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.164316 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6596cd87f9-6htd4" podStartSLOduration=1.151843786 podStartE2EDuration="7.164302462s" totalImagesPullingTime="6.012458676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:11.16312951 +0000 UTC m=+105.990784956" watchObservedRunningTime="2026-09-06 02:53:11.164302462 +0000 UTC m=+105.991957873" Sep 06 02:53:11.182910 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.182861 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6fc545fd6b-wqfjm" podStartSLOduration=1.036969027 podStartE2EDuration="7.182841937s" totalImagesPullingTime="6.14587291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:11.181939857 +0000 UTC m=+106.009595310" watchObservedRunningTime="2026-09-06 02:53:11.182841937 +0000 UTC m=+106.010497358" Sep 06 02:53:11.990094 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:11.989991 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:12.090961 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:12.090922 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:12.151633 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:12.151593 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hbvb" event={"ID":"c8d3bb5d-8dd7-43a2-b136-46aa93879681","Type":"ContainerStarted","Data":"599da7f7f3197899825930245aa4f5e9e882041fe61ae298c9cfe8f94f294cfa"} Sep 06 02:53:12.151831 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:12.151662 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hbvb" event={"ID":"c8d3bb5d-8dd7-43a2-b136-46aa93879681","Type":"ContainerStarted","Data":"792eed3da9b93c8c646c77fa00a7a03bdaf4b09e39811e73c306c9b03bac62e9"} Sep 06 02:53:13.248797 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.248748 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:13.291005 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.290970 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-84kts"] Sep 06 02:53:13.295433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.295406 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.300193 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.300166 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 06 02:53:13.300449 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.300433 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jpktb\"" Sep 06 02:53:13.301695 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.301671 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 06 02:53:13.302025 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.301989 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 06 02:53:13.302025 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.301995 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 06 02:53:13.302209 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.301995 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 06 02:53:13.307279 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.307231 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-84kts"] Sep 06 02:53:13.366584 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.366549 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:13.419148 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.419115 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b0771c-68be-409b-b5f4-f9e52eeef6f4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.419332 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.419162 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znnlg\" (UniqueName: \"kubernetes.io/projected/22b0771c-68be-409b-b5f4-f9e52eeef6f4-kube-api-access-znnlg\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.419332 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.419186 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22b0771c-68be-409b-b5f4-f9e52eeef6f4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.419332 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.419263 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b0771c-68be-409b-b5f4-f9e52eeef6f4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.472148 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.472060 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:13.520406 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.520375 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b0771c-68be-409b-b5f4-f9e52eeef6f4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.521259 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.520529 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znnlg\" (UniqueName: \"kubernetes.io/projected/22b0771c-68be-409b-b5f4-f9e52eeef6f4-kube-api-access-znnlg\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.521259 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.520562 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22b0771c-68be-409b-b5f4-f9e52eeef6f4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.521259 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.520605 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b0771c-68be-409b-b5f4-f9e52eeef6f4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.521259 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.521250 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22b0771c-68be-409b-b5f4-f9e52eeef6f4-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.523278 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.523246 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/22b0771c-68be-409b-b5f4-f9e52eeef6f4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.523632 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.523611 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/22b0771c-68be-409b-b5f4-f9e52eeef6f4-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.536937 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.536913 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znnlg\" (UniqueName: \"kubernetes.io/projected/22b0771c-68be-409b-b5f4-f9e52eeef6f4-kube-api-access-znnlg\") pod \"prometheus-operator-6f4946db56-84kts\" (UID: \"22b0771c-68be-409b-b5f4-f9e52eeef6f4\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.608552 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.608519 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" Sep 06 02:53:13.890667 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:13.890639 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-84kts"] Sep 06 02:53:13.893172 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:13.893139 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b0771c_68be_409b_b5f4_f9e52eeef6f4.slice/crio-fb4dd5b41962bb27285816e4495519d75c101af85e4b63772d0091a72c780de6 WatchSource:0}: Error finding container fb4dd5b41962bb27285816e4495519d75c101af85e4b63772d0091a72c780de6: Status 404 returned error can't find the container with id fb4dd5b41962bb27285816e4495519d75c101af85e4b63772d0091a72c780de6 Sep 06 02:53:14.161837 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:14.161736 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hbvb" event={"ID":"c8d3bb5d-8dd7-43a2-b136-46aa93879681","Type":"ContainerStarted","Data":"82b1dfa1d591aae60b96fd64c62a77ca41cb7e919c8dd9d0743617c9400cfa59"} Sep 06 02:53:14.163046 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:14.163024 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" event={"ID":"22b0771c-68be-409b-b5f4-f9e52eeef6f4","Type":"ContainerStarted","Data":"fb4dd5b41962bb27285816e4495519d75c101af85e4b63772d0091a72c780de6"} Sep 06 02:53:14.180611 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:14.180562 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6hbvb" podStartSLOduration=37.985747988 podStartE2EDuration="40.180542216s" totalImagesPullingTime="2.194794228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 02:52:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:14.179104252 +0000 UTC m=+109.006759695" watchObservedRunningTime="2026-09-06 02:53:14.180542216 +0000 UTC m=+109.008197640" Sep 06 02:53:14.520245 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:14.520196 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:14.520711 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:14.520263 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:14.523307 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:14.523238 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:14.527107 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:14.527068 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:14.618340 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:14.618302 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:15.171374 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:15.171342 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:15.906848 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:15.906803 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6596cd87f9-6htd4"] Sep 06 02:53:17.882320 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:17.882276 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:17.978206 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:17.978149 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:18.135315 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:18.135235 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7fjgw" Sep 06 02:53:18.264787 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:18.264733 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:18.366289 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:18.366255 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:22.193032 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.192951 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" event={"ID":"22b0771c-68be-409b-b5f4-f9e52eeef6f4","Type":"ContainerStarted","Data":"f9d98c344241e6c1be7456b916a9b2db5e1e56797e414c6c922c011d97beba26"} Sep 06 02:53:22.193032 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.193016 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" event={"ID":"22b0771c-68be-409b-b5f4-f9e52eeef6f4","Type":"ContainerStarted","Data":"07f72ce8b30e1cd6f7f76075ff8eabd23471066584c910c277aa8465eb40dec4"} Sep 06 02:53:22.194796 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.194758 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-pg9zc" event={"ID":"0ea0c2c3-2e58-4d4a-a061-6f831544d122","Type":"ContainerStarted","Data":"0c1d04028edfa5fceda6401948786e1973022f8b9a331426fa705de1a744e0be"} Sep 06 02:53:22.195194 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.195172 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-pg9zc" Sep 06 02:53:22.196566 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.196514 2569 patch_prober.go:28] interesting pod/downloads-85d98c998f-pg9zc container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.12:8080/\": dial tcp 10.132.0.12:8080: connect: connection refused" start-of-body= Sep 06 02:53:22.196674 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.196578 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-pg9zc" podUID="0ea0c2c3-2e58-4d4a-a061-6f831544d122" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.12:8080/\": dial tcp 10.132.0.12:8080: connect: connection refused" Sep 06 02:53:22.211343 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.211295 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-84kts" podStartSLOduration=1.163876584 podStartE2EDuration="9.211281991s" totalImagesPullingTime="8.047405407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:22.210858749 +0000 UTC m=+117.038514232" watchObservedRunningTime="2026-09-06 02:53:22.211281991 +0000 UTC m=+117.038937411" Sep 06 02:53:22.225009 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.224981 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:22.228963 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:22.228924 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-pg9zc" podStartSLOduration=1.052495421 podStartE2EDuration="18.228910432s" totalImagesPullingTime="17.176415011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:22.227623887 +0000 UTC m=+117.055279324" watchObservedRunningTime="2026-09-06 02:53:22.228910432 +0000 UTC m=+117.056565843" Sep 06 02:53:23.116547 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.116508 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:23.214886 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.214852 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-pg9zc" Sep 06 02:53:23.395864 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.395757 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:23.641273 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.641235 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:23.667231 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.667144 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw"] Sep 06 02:53:23.685147 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.685117 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw"] Sep 06 02:53:23.685296 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.685254 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.689311 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.689288 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8fxrs\"" Sep 06 02:53:23.689537 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.689514 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 06 02:53:23.690322 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.690302 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lqcdz"] Sep 06 02:53:23.691448 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.691425 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 06 02:53:23.699992 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.699969 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.702367 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.702346 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr"] Sep 06 02:53:23.703457 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.703411 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 06 02:53:23.703681 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.703411 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 06 02:53:23.703793 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.703428 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 06 02:53:23.703869 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.703544 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4pt5n\"" Sep 06 02:53:23.714670 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.714652 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.717619 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.717579 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 06 02:53:23.717716 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.717661 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 06 02:53:23.717798 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.717666 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 06 02:53:23.717895 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.717870 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-sfmgs\"" Sep 06 02:53:23.727195 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.727172 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr"] Sep 06 02:53:23.777121 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.777080 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:23.812923 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.812885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d83f330-e173-4854-b059-a9cd17f6705b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.812923 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.812922 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-root\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.813147 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.812947 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.813147 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.812976 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-wtmp\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.813147 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813035 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkcbm\" (UniqueName: \"kubernetes.io/projected/80bab8b7-d52a-4989-b876-d867529df6ba-kube-api-access-hkcbm\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.813147 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813109 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d83f330-e173-4854-b059-a9cd17f6705b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.813338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813145 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad582415-9947-419e-9c31-3418498fff62-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.813338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813176 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad582415-9947-419e-9c31-3418498fff62-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.813338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813205 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-textfile\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.813338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813236 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.813338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813285 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bab8b7-d52a-4989-b876-d867529df6ba-metrics-client-ca\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.813338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813318 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.813614 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813354 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.813614 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813375 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.813614 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813423 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d83f330-e173-4854-b059-a9cd17f6705b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.813614 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813461 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-tls\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.813614 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813505 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhm6g\" (UniqueName: \"kubernetes.io/projected/3d83f330-e173-4854-b059-a9cd17f6705b-kube-api-access-rhm6g\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.813614 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813539 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkq5k\" (UniqueName: \"kubernetes.io/projected/ad582415-9947-419e-9c31-3418498fff62-kube-api-access-tkq5k\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.813614 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.813610 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-sys\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.866732 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.866699 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:23.914822 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.914789 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad582415-9947-419e-9c31-3418498fff62-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.914986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.914834 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad582415-9947-419e-9c31-3418498fff62-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.914986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.914867 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-textfile\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.914986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.914901 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.914986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.914936 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bab8b7-d52a-4989-b876-d867529df6ba-metrics-client-ca\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.914986 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.914960 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.914998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915026 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915055 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d83f330-e173-4854-b059-a9cd17f6705b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915086 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-tls\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915118 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhm6g\" (UniqueName: \"kubernetes.io/projected/3d83f330-e173-4854-b059-a9cd17f6705b-kube-api-access-rhm6g\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915139 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkq5k\" (UniqueName: \"kubernetes.io/projected/ad582415-9947-419e-9c31-3418498fff62-kube-api-access-tkq5k\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915166 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-sys\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915199 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d83f330-e173-4854-b059-a9cd17f6705b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915222 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-root\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.915249 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915241 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-textfile\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.915738 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915248 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.915738 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:53:23.915282 2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 06 02:53:23.915738 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915293 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-wtmp\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.915738 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkcbm\" (UniqueName: \"kubernetes.io/projected/80bab8b7-d52a-4989-b876-d867529df6ba-kube-api-access-hkcbm\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.915738 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915330 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-sys\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.915738 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:53:23.915348 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-tls podName:80bab8b7-d52a-4989-b876-d867529df6ba nodeName:}" failed. No retries permitted until 2026-09-06 02:53:24.415330356 +0000 UTC m=+119.242985760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-tls") pod "node-exporter-lqcdz" (UID: "80bab8b7-d52a-4989-b876-d867529df6ba") : secret "node-exporter-tls" not found Sep 06 02:53:23.915738 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915389 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d83f330-e173-4854-b059-a9cd17f6705b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.916127 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915751 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad582415-9947-419e-9c31-3418498fff62-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.916127 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.915278 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad582415-9947-419e-9c31-3418498fff62-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.916127 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.916103 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.916431 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.916403 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d83f330-e173-4854-b059-a9cd17f6705b-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.916541 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.916514 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.916852 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.916829 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bab8b7-d52a-4989-b876-d867529df6ba-metrics-client-ca\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.916951 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.916900 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-root\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.917050 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.916962 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-wtmp\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.918607 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.918552 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d83f330-e173-4854-b059-a9cd17f6705b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.918607 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.918583 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.919236 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.919193 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad582415-9947-419e-9c31-3418498fff62-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.919542 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.919516 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d83f330-e173-4854-b059-a9cd17f6705b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.919790 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.919745 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.932151 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.932121 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkcbm\" (UniqueName: \"kubernetes.io/projected/80bab8b7-d52a-4989-b876-d867529df6ba-kube-api-access-hkcbm\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:23.932492 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.932467 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhm6g\" (UniqueName: \"kubernetes.io/projected/3d83f330-e173-4854-b059-a9cd17f6705b-kube-api-access-rhm6g\") pod \"openshift-state-metrics-657fd6c54-4shzw\" (UID: \"3d83f330-e173-4854-b059-a9cd17f6705b\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:23.936863 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.936841 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkq5k\" (UniqueName: \"kubernetes.io/projected/ad582415-9947-419e-9c31-3418498fff62-kube-api-access-tkq5k\") pod \"kube-state-metrics-74cb57df7-fg4xr\" (UID: \"ad582415-9947-419e-9c31-3418498fff62\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:23.998489 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:23.998445 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" Sep 06 02:53:24.024685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.024647 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" Sep 06 02:53:24.032997 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.032921 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:24.135815 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.135783 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:24.233947 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.233861 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:24.296374 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.296302 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw"] Sep 06 02:53:24.299184 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:24.299152 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d83f330_e173_4854_b059_a9cd17f6705b.slice/crio-c76bbd580bd1b712e426a5f4e120ec425a33a4f052a6e7b5399b159f7b06719c WatchSource:0}: Error finding container c76bbd580bd1b712e426a5f4e120ec425a33a4f052a6e7b5399b159f7b06719c: Status 404 returned error can't find the container with id c76bbd580bd1b712e426a5f4e120ec425a33a4f052a6e7b5399b159f7b06719c Sep 06 02:53:24.329726 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.329701 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr"] Sep 06 02:53:24.332118 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:24.332092 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad582415_9947_419e_9c31_3418498fff62.slice/crio-327080cd340555bf0a74d7031e2354bbd64c20b0f24a8f7d2e1fbfc0ffc915b8 WatchSource:0}: Error finding container 327080cd340555bf0a74d7031e2354bbd64c20b0f24a8f7d2e1fbfc0ffc915b8: Status 404 returned error can't find the container with id 327080cd340555bf0a74d7031e2354bbd64c20b0f24a8f7d2e1fbfc0ffc915b8 Sep 06 02:53:24.420334 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.420304 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-tls\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:24.423348 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.423325 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bab8b7-d52a-4989-b876-d867529df6ba-node-exporter-tls\") pod \"node-exporter-lqcdz\" (UID: \"80bab8b7-d52a-4989-b876-d867529df6ba\") " pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:24.610949 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.610915 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lqcdz" Sep 06 02:53:24.630959 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.630924 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:24.635590 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:24.635558 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bab8b7_d52a_4989_b876_d867529df6ba.slice/crio-d3ab3c3e09731f90103caa350becd923fb04e315a873fb67cc2b7cdee0ada508 WatchSource:0}: Error finding container d3ab3c3e09731f90103caa350becd923fb04e315a873fb67cc2b7cdee0ada508: Status 404 returned error can't find the container with id d3ab3c3e09731f90103caa350becd923fb04e315a873fb67cc2b7cdee0ada508 Sep 06 02:53:24.731284 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:24.731251 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:25.144256 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:25.144204 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:25.209116 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:25.209025 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" event={"ID":"ad582415-9947-419e-9c31-3418498fff62","Type":"ContainerStarted","Data":"327080cd340555bf0a74d7031e2354bbd64c20b0f24a8f7d2e1fbfc0ffc915b8"} Sep 06 02:53:25.211692 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:25.211660 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" event={"ID":"3d83f330-e173-4854-b059-a9cd17f6705b","Type":"ContainerStarted","Data":"6a2e2a14064361a7f4d5e92bd49fd3d28acbbafd098159f875d1bcf09c7401dc"} Sep 06 02:53:25.211827 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:25.211724 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" event={"ID":"3d83f330-e173-4854-b059-a9cd17f6705b","Type":"ContainerStarted","Data":"83b965ee2a705f83033dc7c403302d44c7b777655df5540ad64e952ff2ac228b"} Sep 06 02:53:25.211827 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:25.211755 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" event={"ID":"3d83f330-e173-4854-b059-a9cd17f6705b","Type":"ContainerStarted","Data":"c76bbd580bd1b712e426a5f4e120ec425a33a4f052a6e7b5399b159f7b06719c"} Sep 06 02:53:25.214021 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:25.213952 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqcdz" event={"ID":"80bab8b7-d52a-4989-b876-d867529df6ba","Type":"ContainerStarted","Data":"d3ab3c3e09731f90103caa350becd923fb04e315a873fb67cc2b7cdee0ada508"} Sep 06 02:53:25.313881 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:25.313820 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:25.412723 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:25.412566 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:26.120198 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:26.120168 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:53:26.357451 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:26.357404 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:26.457992 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:26.457901 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:26.572897 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:26.572664 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:26.652316 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:26.652264 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:26.726406 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:26.726305 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:26.933571 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:26.933540 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:27.224942 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:27.224910 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" event={"ID":"ad582415-9947-419e-9c31-3418498fff62","Type":"ContainerStarted","Data":"f104ca4e79a254c5183ddef67a6632ce64b860867dc3c45bfe6613bc68354f1f"} Sep 06 02:53:27.228109 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:27.228078 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" event={"ID":"3d83f330-e173-4854-b059-a9cd17f6705b","Type":"ContainerStarted","Data":"a9ca101b73890af42089dbe725cab9ed0b1e802e694cfcccd54f169ed7ecc1be"} Sep 06 02:53:27.237697 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:27.237641 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqcdz" event={"ID":"80bab8b7-d52a-4989-b876-d867529df6ba","Type":"ContainerStarted","Data":"a519956f7f0feee4a0a8d4757afb1b1f53c5f15835c620466b40e4c5bf2069b8"} Sep 06 02:53:27.316161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:27.316110 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-4shzw" podStartSLOduration=1.781983307 podStartE2EDuration="4.316087172s" totalImagesPullingTime="2.534103865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:27.267012392 +0000 UTC m=+122.094667814" watchObservedRunningTime="2026-09-06 02:53:27.316087172 +0000 UTC m=+122.143742618" Sep 06 02:53:27.861466 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:27.861432 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68dd5678f5-766jh"] Sep 06 02:53:27.949826 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:27.949749 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:28.011525 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.011491 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:28.095699 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.095664 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b8665756c-2qh8g"] Sep 06 02:53:28.127058 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.126988 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b8665756c-2qh8g"] Sep 06 02:53:28.127189 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.127089 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.130201 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.129981 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 06 02:53:28.130201 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.130070 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 06 02:53:28.130201 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.130070 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 06 02:53:28.130201 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.130093 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4vjus1svuss7h\"" Sep 06 02:53:28.130201 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.130197 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jf59z\"" Sep 06 02:53:28.130546 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.130405 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 06 02:53:28.244175 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.244141 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" event={"ID":"ad582415-9947-419e-9c31-3418498fff62","Type":"ContainerStarted","Data":"ce1ff292f423edbfd3397fd740eb75cd4b5a5c279a2598d47a3866fa7e7e3bf1"} Sep 06 02:53:28.244351 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.244205 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" event={"ID":"ad582415-9947-419e-9c31-3418498fff62","Type":"ContainerStarted","Data":"ba49e81ad2e9ce27df2112e08f4bc55147f26a62797cc7f42cc7b5ab119ba12d"} Sep 06 02:53:28.246027 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.245998 2569 generic.go:356] "Generic (PLEG): container finished" podID="80bab8b7-d52a-4989-b876-d867529df6ba" containerID="a519956f7f0feee4a0a8d4757afb1b1f53c5f15835c620466b40e4c5bf2069b8" exitCode=0 Sep 06 02:53:28.246161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.246088 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqcdz" event={"ID":"80bab8b7-d52a-4989-b876-d867529df6ba","Type":"ContainerDied","Data":"a519956f7f0feee4a0a8d4757afb1b1f53c5f15835c620466b40e4c5bf2069b8"} Sep 06 02:53:28.256950 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.256923 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-secret-metrics-server-client-certs\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.257053 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.256962 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f2074178-13ab-4105-9236-c04f9394e3f3-metrics-server-audit-profiles\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.257053 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.257010 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-secret-metrics-server-tls\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.257147 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.257065 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f2074178-13ab-4105-9236-c04f9394e3f3-audit-log\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.257147 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.257088 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-client-ca-bundle\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.257219 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.257177 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2074178-13ab-4105-9236-c04f9394e3f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.257219 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.257209 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm9sk\" (UniqueName: \"kubernetes.io/projected/f2074178-13ab-4105-9236-c04f9394e3f3-kube-api-access-vm9sk\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.262459 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.262420 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-fg4xr" podStartSLOduration=2.557817169 podStartE2EDuration="5.262402239s" totalImagesPullingTime="2.70458507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:28.261129429 +0000 UTC m=+123.088784860" watchObservedRunningTime="2026-09-06 02:53:28.262402239 +0000 UTC m=+123.090057658" Sep 06 02:53:28.357797 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.357758 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f2074178-13ab-4105-9236-c04f9394e3f3-audit-log\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.357904 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.357809 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-client-ca-bundle\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.358011 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.357989 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2074178-13ab-4105-9236-c04f9394e3f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.358119 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.358090 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm9sk\" (UniqueName: \"kubernetes.io/projected/f2074178-13ab-4105-9236-c04f9394e3f3-kube-api-access-vm9sk\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.358186 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.358129 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f2074178-13ab-4105-9236-c04f9394e3f3-audit-log\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.358186 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.358148 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-secret-metrics-server-client-certs\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.358291 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.358182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f2074178-13ab-4105-9236-c04f9394e3f3-metrics-server-audit-profiles\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.358291 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.358257 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-secret-metrics-server-tls\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.359427 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.359400 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f2074178-13ab-4105-9236-c04f9394e3f3-metrics-server-audit-profiles\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.359642 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.359613 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2074178-13ab-4105-9236-c04f9394e3f3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.361883 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.361858 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-client-ca-bundle\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.361971 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.361932 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-secret-metrics-server-client-certs\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.362839 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.362815 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f2074178-13ab-4105-9236-c04f9394e3f3-secret-metrics-server-tls\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.369021 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.368999 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm9sk\" (UniqueName: \"kubernetes.io/projected/f2074178-13ab-4105-9236-c04f9394e3f3-kube-api-access-vm9sk\") pod \"metrics-server-b8665756c-2qh8g\" (UID: \"f2074178-13ab-4105-9236-c04f9394e3f3\") " pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.438210 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.438141 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:28.445668 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.445639 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:28.561966 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.561861 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:28.683228 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.683148 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:28.751660 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.751619 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b8665756c-2qh8g"] Sep 06 02:53:28.754793 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:28.754743 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2074178_13ab_4105_9236_c04f9394e3f3.slice/crio-28a55d3a19f3e71a17a07732ed887596b351cd1594e7b2a4cfa12c4a346b1332 WatchSource:0}: Error finding container 28a55d3a19f3e71a17a07732ed887596b351cd1594e7b2a4cfa12c4a346b1332: Status 404 returned error can't find the container with id 28a55d3a19f3e71a17a07732ed887596b351cd1594e7b2a4cfa12c4a346b1332 Sep 06 02:53:28.938258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:28.938166 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:29.040403 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.040356 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:29.253254 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.253209 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqcdz" event={"ID":"80bab8b7-d52a-4989-b876-d867529df6ba","Type":"ContainerStarted","Data":"7c817e3972853820a6e19899b855992d1cefa55354adc403e5e5b3e34208cef3"} Sep 06 02:53:29.253427 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.253278 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lqcdz" event={"ID":"80bab8b7-d52a-4989-b876-d867529df6ba","Type":"ContainerStarted","Data":"b95b65d8335cca401fa91e3d2d9b227394608c8b826e145a6deb4d77b260aaa0"} Sep 06 02:53:29.254701 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.254671 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" event={"ID":"f2074178-13ab-4105-9236-c04f9394e3f3","Type":"ContainerStarted","Data":"28a55d3a19f3e71a17a07732ed887596b351cd1594e7b2a4cfa12c4a346b1332"} Sep 06 02:53:29.275740 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.275692 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lqcdz" podStartSLOduration=3.783228562 podStartE2EDuration="6.275673099s" totalImagesPullingTime="2.402728135s" totalInitContainerRuntime="89.716402ms" isStatefulPod=true podCreationTimestamp="2026-09-06 02:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:29.274703173 +0000 UTC m=+124.102358593" watchObservedRunningTime="2026-09-06 02:53:29.275673099 +0000 UTC m=+124.103328520" Sep 06 02:53:29.885151 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.885109 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:29.890891 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.890858 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:53:29.915024 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.914992 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:53:29.915193 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.915142 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:29.920517 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.920049 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 06 02:53:29.920517 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.920092 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d6msw\"" Sep 06 02:53:29.920517 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.920154 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 06 02:53:29.920517 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.920257 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 06 02:53:29.920517 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.920373 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 06 02:53:29.920517 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.920414 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 06 02:53:29.920517 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.920476 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 06 02:53:29.920970 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.920594 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 06 02:53:29.922062 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.921365 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 06 02:53:29.922062 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.921550 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 06 02:53:29.922062 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.921715 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 06 02:53:29.923895 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.923470 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 06 02:53:29.924258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.924182 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 06 02:53:29.924479 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.924351 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9t1gq401p0fqo\"" Sep 06 02:53:29.924645 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.924561 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 06 02:53:29.927346 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:29.927323 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 06 02:53:30.077928 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.077838 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.077928 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.077885 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.077928 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.077916 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.077951 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.077979 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078020 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078045 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078068 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg6x5\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-kube-api-access-kg6x5\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078094 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078120 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078154 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078175 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078215 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078237 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078280 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078324 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078350 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-config\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078372 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.078509 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078399 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.079322 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.078420 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179495 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179495 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179323 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179495 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179373 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg6x5\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-kube-api-access-kg6x5\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179495 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179495 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179437 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179495 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179481 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179940 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179510 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179940 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179551 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179940 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179593 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179940 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179622 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179940 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179653 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179940 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179680 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-config\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179940 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179703 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.179940 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179739 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.180337 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.180183 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.180523 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.183898 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.184510 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.185352 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.186291 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.179788 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.186436 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.186470 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.186501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.186551 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.186586 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.187716 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.188130 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.188205 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.188977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.188926 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.190729 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.190690 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.190877 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.190766 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-config-out\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.191242 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.191219 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.194584 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.194555 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.195054 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.195032 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.196130 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.195749 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg6x5\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-kube-api-access-kg6x5\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.196130 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.196021 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-config\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.196958 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.196936 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-web-config\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.204443 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.204366 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.204443 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.204418 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.231526 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.231493 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:30.914990 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:30.914967 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:53:31.018129 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:31.018090 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f232db_c75c_4c4b_9098_786a83464a49.slice/crio-359fe86f619bfe65df5776ef620b26bebf19e3f83bae7654df221b00864082a9 WatchSource:0}: Error finding container 359fe86f619bfe65df5776ef620b26bebf19e3f83bae7654df221b00864082a9: Status 404 returned error can't find the container with id 359fe86f619bfe65df5776ef620b26bebf19e3f83bae7654df221b00864082a9 Sep 06 02:53:31.153918 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:31.153888 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:31.253469 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:31.253436 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:31.266075 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:31.266042 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" event={"ID":"f2074178-13ab-4105-9236-c04f9394e3f3","Type":"ContainerStarted","Data":"1c604395432c344197e378c194086dc07cfd18c93e8d9b09a347140280e692c4"} Sep 06 02:53:31.267254 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:31.267232 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerStarted","Data":"359fe86f619bfe65df5776ef620b26bebf19e3f83bae7654df221b00864082a9"} Sep 06 02:53:33.277989 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:33.277952 2569 generic.go:356] "Generic (PLEG): container finished" podID="d4f232db-c75c-4c4b-9098-786a83464a49" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" exitCode=0 Sep 06 02:53:33.278399 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:33.278046 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerDied","Data":"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664"} Sep 06 02:53:33.311305 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:33.311265 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" podStartSLOduration=3.01861058 podStartE2EDuration="5.311251707s" totalImagesPullingTime="2.292641127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:31.288329571 +0000 UTC m=+126.115985003" watchObservedRunningTime="2026-09-06 02:53:33.311251707 +0000 UTC m=+128.138907127" Sep 06 02:53:35.046824 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:35.046767 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:35.146037 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:35.145991 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:35.251421 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:35.251384 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:35.439073 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:35.438986 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:53:35.441697 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:35.441673 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b26ede6-74e1-428a-b8bb-15ad8032380a-metrics-certs\") pod \"network-metrics-daemon-ns26g\" (UID: \"8b26ede6-74e1-428a-b8bb-15ad8032380a\") " pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:53:35.559988 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:35.559954 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qvfrq\"" Sep 06 02:53:35.568141 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:35.568112 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ns26g" Sep 06 02:53:36.658627 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:36.658605 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ns26g"] Sep 06 02:53:36.708993 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:53:36.708959 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b26ede6_74e1_428a_b8bb_15ad8032380a.slice/crio-db58fb551c9dffad9eabee4db193c273c41d1bb81ff449c5d93977987cc89390 WatchSource:0}: Error finding container db58fb551c9dffad9eabee4db193c273c41d1bb81ff449c5d93977987cc89390: Status 404 returned error can't find the container with id db58fb551c9dffad9eabee4db193c273c41d1bb81ff449c5d93977987cc89390 Sep 06 02:53:37.305129 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:37.305084 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerStarted","Data":"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b"} Sep 06 02:53:37.305400 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:37.305194 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerStarted","Data":"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd"} Sep 06 02:53:37.306373 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:37.306348 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ns26g" event={"ID":"8b26ede6-74e1-428a-b8bb-15ad8032380a","Type":"ContainerStarted","Data":"db58fb551c9dffad9eabee4db193c273c41d1bb81ff449c5d93977987cc89390"} Sep 06 02:53:38.313145 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:38.313081 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ns26g" event={"ID":"8b26ede6-74e1-428a-b8bb-15ad8032380a","Type":"ContainerStarted","Data":"f958ea905e03fee736b7316c481f0128cf24f665f1d6c6a5e1f13fd53fad49cf"} Sep 06 02:53:39.320447 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:39.320410 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ns26g" event={"ID":"8b26ede6-74e1-428a-b8bb-15ad8032380a","Type":"ContainerStarted","Data":"8229addc919963fb5b7a9f961b2c52b73288abf0e8364b3ca5966eae1ee39408"} Sep 06 02:53:39.340221 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:39.340173 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ns26g" podStartSLOduration=132.016617807 podStartE2EDuration="2m13.340157675s" totalImagesPullingTime="1.323539868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:39.338759112 +0000 UTC m=+134.166414533" watchObservedRunningTime="2026-09-06 02:53:39.340157675 +0000 UTC m=+134.167813095" Sep 06 02:53:39.441510 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:39.441475 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:39.542616 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:39.542579 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:39.980192 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:39.980154 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:40.092937 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:40.092897 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:40.177295 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:40.177194 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:40.327651 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:40.327620 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerStarted","Data":"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7"} Sep 06 02:53:40.327994 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:40.327681 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerStarted","Data":"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793"} Sep 06 02:53:40.327994 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:40.327709 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerStarted","Data":"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2"} Sep 06 02:53:40.327994 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:40.327731 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerStarted","Data":"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c"} Sep 06 02:53:40.358849 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:40.358785 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.875178977 podStartE2EDuration="11.358750489s" totalImagesPullingTime="7.457448117s" totalInitContainerRuntime="26.123395ms" isStatefulPod=false podCreationTimestamp="2026-09-06 02:53:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:53:40.357335798 +0000 UTC m=+135.184991254" watchObservedRunningTime="2026-09-06 02:53:40.358750489 +0000 UTC m=+135.186405909" Sep 06 02:53:42.194129 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.194085 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6596cd87f9-6htd4" podUID="2451bbe3-0455-439d-a89d-39a3c8273fc5" containerName="console" containerID="cri-o://c37343562c5e77fc905ccaf8113fb82c2a62b05819e09176345e4feb288a467a" gracePeriod=15 Sep 06 02:53:42.336972 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.336937 2569 generic.go:356] "Generic (PLEG): container finished" podID="2451bbe3-0455-439d-a89d-39a3c8273fc5" containerID="c37343562c5e77fc905ccaf8113fb82c2a62b05819e09176345e4feb288a467a" exitCode=0 Sep 06 02:53:42.337145 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.336984 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6596cd87f9-6htd4" event={"ID":"2451bbe3-0455-439d-a89d-39a3c8273fc5","Type":"ContainerDied","Data":"c37343562c5e77fc905ccaf8113fb82c2a62b05819e09176345e4feb288a467a"} Sep 06 02:53:42.451983 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.451927 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:42.503001 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.502971 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-service-ca\") pod \"2451bbe3-0455-439d-a89d-39a3c8273fc5\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " Sep 06 02:53:42.503166 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.503009 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-oauth-config\") pod \"2451bbe3-0455-439d-a89d-39a3c8273fc5\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " Sep 06 02:53:42.503166 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.503059 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qptgn\" (UniqueName: \"kubernetes.io/projected/2451bbe3-0455-439d-a89d-39a3c8273fc5-kube-api-access-qptgn\") pod \"2451bbe3-0455-439d-a89d-39a3c8273fc5\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " Sep 06 02:53:42.503166 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.503100 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-serving-cert\") pod \"2451bbe3-0455-439d-a89d-39a3c8273fc5\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " Sep 06 02:53:42.503166 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.503129 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-oauth-serving-cert\") pod \"2451bbe3-0455-439d-a89d-39a3c8273fc5\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " Sep 06 02:53:42.503374 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.503168 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-config\") pod \"2451bbe3-0455-439d-a89d-39a3c8273fc5\" (UID: \"2451bbe3-0455-439d-a89d-39a3c8273fc5\") " Sep 06 02:53:42.503436 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.503394 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-service-ca" (OuterVolumeSpecName: "service-ca") pod "2451bbe3-0455-439d-a89d-39a3c8273fc5" (UID: "2451bbe3-0455-439d-a89d-39a3c8273fc5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:53:42.503615 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.503591 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2451bbe3-0455-439d-a89d-39a3c8273fc5" (UID: "2451bbe3-0455-439d-a89d-39a3c8273fc5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:53:42.503615 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.503593 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-config" (OuterVolumeSpecName: "console-config") pod "2451bbe3-0455-439d-a89d-39a3c8273fc5" (UID: "2451bbe3-0455-439d-a89d-39a3c8273fc5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:53:42.505303 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.505281 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2451bbe3-0455-439d-a89d-39a3c8273fc5" (UID: "2451bbe3-0455-439d-a89d-39a3c8273fc5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:53:42.505389 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.505331 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2451bbe3-0455-439d-a89d-39a3c8273fc5-kube-api-access-qptgn" (OuterVolumeSpecName: "kube-api-access-qptgn") pod "2451bbe3-0455-439d-a89d-39a3c8273fc5" (UID: "2451bbe3-0455-439d-a89d-39a3c8273fc5"). InnerVolumeSpecName "kube-api-access-qptgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 02:53:42.505389 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.505370 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2451bbe3-0455-439d-a89d-39a3c8273fc5" (UID: "2451bbe3-0455-439d-a89d-39a3c8273fc5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:53:42.604481 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.604448 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qptgn\" (UniqueName: \"kubernetes.io/projected/2451bbe3-0455-439d-a89d-39a3c8273fc5-kube-api-access-qptgn\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:42.604481 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.604481 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-serving-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:42.604670 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.604493 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-oauth-serving-cert\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:42.604670 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.604506 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:42.604670 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.604517 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2451bbe3-0455-439d-a89d-39a3c8273fc5-service-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:42.604670 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.604527 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2451bbe3-0455-439d-a89d-39a3c8273fc5-console-oauth-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:42.716041 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.715947 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:42.776171 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:42.776136 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:53:43.342177 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:43.342147 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6596cd87f9-6htd4" Sep 06 02:53:43.342177 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:43.342169 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6596cd87f9-6htd4" event={"ID":"2451bbe3-0455-439d-a89d-39a3c8273fc5","Type":"ContainerDied","Data":"5e9f0972a4c5da211ddbc32b6a43467546620a12eea7d4ac59261e28b0e219f5"} Sep 06 02:53:43.342635 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:43.342228 2569 scope.go:117] "RemoveContainer" containerID="c37343562c5e77fc905ccaf8113fb82c2a62b05819e09176345e4feb288a467a" Sep 06 02:53:43.363671 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:43.363645 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6596cd87f9-6htd4"] Sep 06 02:53:43.367954 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:43.367933 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6596cd87f9-6htd4"] Sep 06 02:53:43.649663 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:43.649588 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2451bbe3-0455-439d-a89d-39a3c8273fc5" path="/var/lib/kubelet/pods/2451bbe3-0455-439d-a89d-39a3c8273fc5/volumes" Sep 06 02:53:45.232211 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:45.232173 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:53:48.438795 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:48.438731 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:48.439181 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:48.438815 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:53:52.884264 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:52.884204 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" podUID="b5aa6044-1c9b-4370-9f2f-301acb247e41" containerName="registry" containerID="cri-o://e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12" gracePeriod=30 Sep 06 02:53:53.151045 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.150993 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:53:53.290908 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.290878 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-installation-pull-secrets\") pod \"b5aa6044-1c9b-4370-9f2f-301acb247e41\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " Sep 06 02:53:53.291057 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.290918 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-image-registry-private-configuration\") pod \"b5aa6044-1c9b-4370-9f2f-301acb247e41\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " Sep 06 02:53:53.291057 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.290937 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5aa6044-1c9b-4370-9f2f-301acb247e41-ca-trust-extracted\") pod \"b5aa6044-1c9b-4370-9f2f-301acb247e41\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " Sep 06 02:53:53.291057 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.290959 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") pod \"b5aa6044-1c9b-4370-9f2f-301acb247e41\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " Sep 06 02:53:53.291057 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.291015 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lshgx\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-kube-api-access-lshgx\") pod \"b5aa6044-1c9b-4370-9f2f-301acb247e41\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " Sep 06 02:53:53.291057 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.291045 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-trusted-ca\") pod \"b5aa6044-1c9b-4370-9f2f-301acb247e41\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " Sep 06 02:53:53.291327 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.291062 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-certificates\") pod \"b5aa6044-1c9b-4370-9f2f-301acb247e41\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " Sep 06 02:53:53.291462 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.291089 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-bound-sa-token\") pod \"b5aa6044-1c9b-4370-9f2f-301acb247e41\" (UID: \"b5aa6044-1c9b-4370-9f2f-301acb247e41\") " Sep 06 02:53:53.291589 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.291461 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b5aa6044-1c9b-4370-9f2f-301acb247e41" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:53:53.291589 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.291551 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b5aa6044-1c9b-4370-9f2f-301acb247e41" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:53:53.291793 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.291753 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-trusted-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:53.291878 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.291799 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-certificates\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:53.293376 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.293345 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b5aa6044-1c9b-4370-9f2f-301acb247e41" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 02:53:53.293623 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.293592 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b5aa6044-1c9b-4370-9f2f-301acb247e41" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:53:53.293725 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.293659 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b5aa6044-1c9b-4370-9f2f-301acb247e41" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:53:53.293725 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.293682 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-kube-api-access-lshgx" (OuterVolumeSpecName: "kube-api-access-lshgx") pod "b5aa6044-1c9b-4370-9f2f-301acb247e41" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41"). InnerVolumeSpecName "kube-api-access-lshgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 02:53:53.293979 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.293963 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b5aa6044-1c9b-4370-9f2f-301acb247e41" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 02:53:53.302032 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.302006 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5aa6044-1c9b-4370-9f2f-301acb247e41-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b5aa6044-1c9b-4370-9f2f-301acb247e41" (UID: "b5aa6044-1c9b-4370-9f2f-301acb247e41"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 02:53:53.382453 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.382427 2569 generic.go:356] "Generic (PLEG): container finished" podID="b5aa6044-1c9b-4370-9f2f-301acb247e41" containerID="e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12" exitCode=0 Sep 06 02:53:53.382536 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.382459 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" event={"ID":"b5aa6044-1c9b-4370-9f2f-301acb247e41","Type":"ContainerDied","Data":"e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12"} Sep 06 02:53:53.382579 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.382543 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" event={"ID":"b5aa6044-1c9b-4370-9f2f-301acb247e41","Type":"ContainerDied","Data":"daee62614409bc9f411d4e9c5a2ae362716e24e5df393768a18dcae4ec5dfac4"} Sep 06 02:53:53.382579 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.382470 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dd5678f5-766jh" Sep 06 02:53:53.382662 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.382555 2569 scope.go:117] "RemoveContainer" containerID="e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12" Sep 06 02:53:53.391070 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.391056 2569 scope.go:117] "RemoveContainer" containerID="e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12" Sep 06 02:53:53.391384 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:53:53.391357 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12\": container with ID starting with e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12 not found: ID does not exist" containerID="e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12" Sep 06 02:53:53.391446 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.391398 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12"} err="failed to get container status \"e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12\": rpc error: code = NotFound desc = could not find container \"e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12\": container with ID starting with e4ba83d1ba62fe94ef1e8b2452d451f06577cacbf1dc1c700f677ed7fb89eb12 not found: ID does not exist" Sep 06 02:53:53.392639 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.392622 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-bound-sa-token\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:53.392692 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.392642 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-installation-pull-secrets\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:53.392692 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.392653 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5aa6044-1c9b-4370-9f2f-301acb247e41-image-registry-private-configuration\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:53.392692 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.392662 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5aa6044-1c9b-4370-9f2f-301acb247e41-ca-trust-extracted\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:53.392692 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.392671 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-registry-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:53.392692 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.392679 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lshgx\" (UniqueName: \"kubernetes.io/projected/b5aa6044-1c9b-4370-9f2f-301acb247e41-kube-api-access-lshgx\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:53:53.403887 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.403842 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68dd5678f5-766jh"] Sep 06 02:53:53.405999 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.405980 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68dd5678f5-766jh"] Sep 06 02:53:53.649834 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:53:53.649809 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5aa6044-1c9b-4370-9f2f-301acb247e41" path="/var/lib/kubelet/pods/b5aa6044-1c9b-4370-9f2f-301acb247e41/volumes" Sep 06 02:54:08.443613 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:08.443582 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:54:08.447508 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:08.447477 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b8665756c-2qh8g" Sep 06 02:54:30.231977 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:30.231944 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:30.247312 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:30.247286 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:30.532955 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:30.532927 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:42.927457 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:42.927424 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:54:43.324495 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:43.324461 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:54:48.306050 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.306014 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:54:48.306673 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.306614 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" gracePeriod=600 Sep 06 02:54:48.306858 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.306821 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="prometheus" containerID="cri-o://19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" gracePeriod=600 Sep 06 02:54:48.307032 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.306834 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy-web" containerID="cri-o://7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" gracePeriod=600 Sep 06 02:54:48.307433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.306834 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="thanos-sidecar" containerID="cri-o://55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" gracePeriod=600 Sep 06 02:54:48.307433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.307113 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy" containerID="cri-o://394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" gracePeriod=600 Sep 06 02:54:48.307433 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.306913 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="config-reloader" containerID="cri-o://ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" gracePeriod=600 Sep 06 02:54:48.559131 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.559075 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599437 2569 generic.go:356] "Generic (PLEG): container finished" podID="d4f232db-c75c-4c4b-9098-786a83464a49" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" exitCode=0 Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599474 2569 generic.go:356] "Generic (PLEG): container finished" podID="d4f232db-c75c-4c4b-9098-786a83464a49" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" exitCode=0 Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599494 2569 generic.go:356] "Generic (PLEG): container finished" podID="d4f232db-c75c-4c4b-9098-786a83464a49" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" exitCode=0 Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599502 2569 generic.go:356] "Generic (PLEG): container finished" podID="d4f232db-c75c-4c4b-9098-786a83464a49" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" exitCode=0 Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599511 2569 generic.go:356] "Generic (PLEG): container finished" podID="d4f232db-c75c-4c4b-9098-786a83464a49" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" exitCode=0 Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599518 2569 generic.go:356] "Generic (PLEG): container finished" podID="d4f232db-c75c-4c4b-9098-786a83464a49" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" exitCode=0 Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599606 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerDied","Data":"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7"} Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599675 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerDied","Data":"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793"} Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599714 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerDied","Data":"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2"} Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599754 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerDied","Data":"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c"} Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599812 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerDied","Data":"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b"} Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599851 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerDied","Data":"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd"} Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599884 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d4f232db-c75c-4c4b-9098-786a83464a49","Type":"ContainerDied","Data":"359fe86f619bfe65df5776ef620b26bebf19e3f83bae7654df221b00864082a9"} Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.599926 2569 scope.go:117] "RemoveContainer" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" Sep 06 02:54:48.600460 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.600130 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:48.612201 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.612180 2569 scope.go:117] "RemoveContainer" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" Sep 06 02:54:48.623154 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.623134 2569 scope.go:117] "RemoveContainer" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" Sep 06 02:54:48.623924 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.623901 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-metrics-client-certs\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624041 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.623947 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-thanos-prometheus-http-client-file\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624041 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.623989 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-2\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624041 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624019 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-kube-rbac-proxy\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624151 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624044 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624151 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624074 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg6x5\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-kube-api-access-kg6x5\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624151 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624107 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-metrics-client-ca\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624151 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624138 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-web-config\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624325 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624163 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-1\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624325 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624203 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-config\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624325 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624241 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-0\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624325 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624276 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-grpc-tls\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624325 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624307 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-config-out\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624618 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624352 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624618 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624379 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-serving-certs-ca-bundle\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624618 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624410 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-db\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624618 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624432 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-tls\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624618 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624465 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-trusted-ca-bundle\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624618 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624510 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-tls-assets\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624618 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624540 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-kubelet-serving-ca-bundle\") pod \"d4f232db-c75c-4c4b-9098-786a83464a49\" (UID: \"d4f232db-c75c-4c4b-9098-786a83464a49\") " Sep 06 02:54:48.624981 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.624897 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:54:48.625188 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.625153 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:54:48.627437 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.627410 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:54:48.627548 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.627523 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 02:54:48.628101 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.627848 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:54:48.630522 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.630493 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:54:48.630640 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.630533 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.630640 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.630545 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.630640 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.630613 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-config-out" (OuterVolumeSpecName: "config-out") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 06 02:54:48.630987 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.630954 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:54:48.631136 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.631119 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.632114 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.632071 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.632297 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.632269 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.632565 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.632535 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 06 02:54:48.633406 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.633381 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.633487 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.633458 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.633829 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.633762 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-config" (OuterVolumeSpecName: "config") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.633905 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.633839 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 02:54:48.634397 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.634334 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-kube-api-access-kg6x5" (OuterVolumeSpecName: "kube-api-access-kg6x5") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "kube-api-access-kg6x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 06 02:54:48.637792 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.637749 2569 scope.go:117] "RemoveContainer" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" Sep 06 02:54:48.648228 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.647296 2569 scope.go:117] "RemoveContainer" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" Sep 06 02:54:48.649003 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.648845 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-web-config" (OuterVolumeSpecName: "web-config") pod "d4f232db-c75c-4c4b-9098-786a83464a49" (UID: "d4f232db-c75c-4c4b-9098-786a83464a49"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 06 02:54:48.656469 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.656448 2569 scope.go:117] "RemoveContainer" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" Sep 06 02:54:48.663768 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.663741 2569 scope.go:117] "RemoveContainer" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" Sep 06 02:54:48.676825 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.676767 2569 scope.go:117] "RemoveContainer" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" Sep 06 02:54:48.677143 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:54:48.677116 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": container with ID starting with 8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7 not found: ID does not exist" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" Sep 06 02:54:48.677221 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.677147 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7"} err="failed to get container status \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": rpc error: code = NotFound desc = could not find container \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": container with ID starting with 8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7 not found: ID does not exist" Sep 06 02:54:48.677221 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.677166 2569 scope.go:117] "RemoveContainer" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" Sep 06 02:54:48.677431 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:54:48.677412 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": container with ID starting with 394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793 not found: ID does not exist" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" Sep 06 02:54:48.677479 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.677435 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793"} err="failed to get container status \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": rpc error: code = NotFound desc = could not find container \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": container with ID starting with 394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793 not found: ID does not exist" Sep 06 02:54:48.677479 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.677448 2569 scope.go:117] "RemoveContainer" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" Sep 06 02:54:48.677677 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:54:48.677658 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": container with ID starting with 7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2 not found: ID does not exist" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" Sep 06 02:54:48.677719 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.677683 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2"} err="failed to get container status \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": rpc error: code = NotFound desc = could not find container \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": container with ID starting with 7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2 not found: ID does not exist" Sep 06 02:54:48.677719 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.677699 2569 scope.go:117] "RemoveContainer" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" Sep 06 02:54:48.677964 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:54:48.677945 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": container with ID starting with 55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c not found: ID does not exist" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" Sep 06 02:54:48.678017 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.677969 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c"} err="failed to get container status \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": rpc error: code = NotFound desc = could not find container \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": container with ID starting with 55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c not found: ID does not exist" Sep 06 02:54:48.678017 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.677988 2569 scope.go:117] "RemoveContainer" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" Sep 06 02:54:48.678222 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:54:48.678208 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": container with ID starting with ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b not found: ID does not exist" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" Sep 06 02:54:48.678258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.678224 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b"} err="failed to get container status \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": rpc error: code = NotFound desc = could not find container \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": container with ID starting with ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b not found: ID does not exist" Sep 06 02:54:48.678258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.678236 2569 scope.go:117] "RemoveContainer" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" Sep 06 02:54:48.678440 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:54:48.678423 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": container with ID starting with 19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd not found: ID does not exist" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" Sep 06 02:54:48.678478 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.678443 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd"} err="failed to get container status \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": rpc error: code = NotFound desc = could not find container \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": container with ID starting with 19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd not found: ID does not exist" Sep 06 02:54:48.678478 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.678454 2569 scope.go:117] "RemoveContainer" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" Sep 06 02:54:48.678671 ip-10-0-141-131 kubenswrapper[2569]: E0906 02:54:48.678655 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": container with ID starting with 8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664 not found: ID does not exist" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" Sep 06 02:54:48.678718 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.678672 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664"} err="failed to get container status \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": rpc error: code = NotFound desc = could not find container \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": container with ID starting with 8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664 not found: ID does not exist" Sep 06 02:54:48.678718 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.678683 2569 scope.go:117] "RemoveContainer" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" Sep 06 02:54:48.678885 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.678869 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7"} err="failed to get container status \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": rpc error: code = NotFound desc = could not find container \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": container with ID starting with 8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7 not found: ID does not exist" Sep 06 02:54:48.678929 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.678885 2569 scope.go:117] "RemoveContainer" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" Sep 06 02:54:48.679127 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.679099 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793"} err="failed to get container status \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": rpc error: code = NotFound desc = could not find container \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": container with ID starting with 394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793 not found: ID does not exist" Sep 06 02:54:48.679127 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.679122 2569 scope.go:117] "RemoveContainer" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" Sep 06 02:54:48.679395 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.679374 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2"} err="failed to get container status \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": rpc error: code = NotFound desc = could not find container \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": container with ID starting with 7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2 not found: ID does not exist" Sep 06 02:54:48.679395 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.679395 2569 scope.go:117] "RemoveContainer" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" Sep 06 02:54:48.679686 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.679665 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c"} err="failed to get container status \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": rpc error: code = NotFound desc = could not find container \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": container with ID starting with 55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c not found: ID does not exist" Sep 06 02:54:48.679744 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.679691 2569 scope.go:117] "RemoveContainer" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" Sep 06 02:54:48.679930 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.679905 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b"} err="failed to get container status \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": rpc error: code = NotFound desc = could not find container \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": container with ID starting with ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b not found: ID does not exist" Sep 06 02:54:48.679930 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.679922 2569 scope.go:117] "RemoveContainer" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" Sep 06 02:54:48.680174 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.680150 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd"} err="failed to get container status \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": rpc error: code = NotFound desc = could not find container \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": container with ID starting with 19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd not found: ID does not exist" Sep 06 02:54:48.680228 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.680174 2569 scope.go:117] "RemoveContainer" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" Sep 06 02:54:48.680377 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.680360 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664"} err="failed to get container status \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": rpc error: code = NotFound desc = could not find container \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": container with ID starting with 8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664 not found: ID does not exist" Sep 06 02:54:48.680415 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.680377 2569 scope.go:117] "RemoveContainer" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" Sep 06 02:54:48.680632 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.680616 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7"} err="failed to get container status \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": rpc error: code = NotFound desc = could not find container \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": container with ID starting with 8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7 not found: ID does not exist" Sep 06 02:54:48.680673 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.680633 2569 scope.go:117] "RemoveContainer" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" Sep 06 02:54:48.680890 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.680870 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793"} err="failed to get container status \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": rpc error: code = NotFound desc = could not find container \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": container with ID starting with 394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793 not found: ID does not exist" Sep 06 02:54:48.680954 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.680891 2569 scope.go:117] "RemoveContainer" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" Sep 06 02:54:48.681095 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681080 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2"} err="failed to get container status \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": rpc error: code = NotFound desc = could not find container \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": container with ID starting with 7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2 not found: ID does not exist" Sep 06 02:54:48.681137 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681096 2569 scope.go:117] "RemoveContainer" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" Sep 06 02:54:48.681327 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681308 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c"} err="failed to get container status \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": rpc error: code = NotFound desc = could not find container \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": container with ID starting with 55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c not found: ID does not exist" Sep 06 02:54:48.681382 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681327 2569 scope.go:117] "RemoveContainer" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" Sep 06 02:54:48.681544 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681530 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b"} err="failed to get container status \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": rpc error: code = NotFound desc = could not find container \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": container with ID starting with ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b not found: ID does not exist" Sep 06 02:54:48.681585 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681545 2569 scope.go:117] "RemoveContainer" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" Sep 06 02:54:48.681737 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681723 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd"} err="failed to get container status \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": rpc error: code = NotFound desc = could not find container \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": container with ID starting with 19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd not found: ID does not exist" Sep 06 02:54:48.681804 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681736 2569 scope.go:117] "RemoveContainer" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" Sep 06 02:54:48.681979 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681962 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664"} err="failed to get container status \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": rpc error: code = NotFound desc = could not find container \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": container with ID starting with 8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664 not found: ID does not exist" Sep 06 02:54:48.682030 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.681978 2569 scope.go:117] "RemoveContainer" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" Sep 06 02:54:48.682168 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.682153 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7"} err="failed to get container status \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": rpc error: code = NotFound desc = could not find container \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": container with ID starting with 8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7 not found: ID does not exist" Sep 06 02:54:48.682208 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.682167 2569 scope.go:117] "RemoveContainer" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" Sep 06 02:54:48.682397 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.682371 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793"} err="failed to get container status \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": rpc error: code = NotFound desc = could not find container \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": container with ID starting with 394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793 not found: ID does not exist" Sep 06 02:54:48.682397 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.682395 2569 scope.go:117] "RemoveContainer" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" Sep 06 02:54:48.682657 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.682633 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2"} err="failed to get container status \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": rpc error: code = NotFound desc = could not find container \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": container with ID starting with 7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2 not found: ID does not exist" Sep 06 02:54:48.682722 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.682659 2569 scope.go:117] "RemoveContainer" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" Sep 06 02:54:48.682939 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.682921 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c"} err="failed to get container status \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": rpc error: code = NotFound desc = could not find container \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": container with ID starting with 55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c not found: ID does not exist" Sep 06 02:54:48.682939 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.682939 2569 scope.go:117] "RemoveContainer" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" Sep 06 02:54:48.683180 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.683159 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b"} err="failed to get container status \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": rpc error: code = NotFound desc = could not find container \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": container with ID starting with ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b not found: ID does not exist" Sep 06 02:54:48.683180 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.683178 2569 scope.go:117] "RemoveContainer" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" Sep 06 02:54:48.683410 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.683391 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd"} err="failed to get container status \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": rpc error: code = NotFound desc = could not find container \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": container with ID starting with 19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd not found: ID does not exist" Sep 06 02:54:48.683410 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.683409 2569 scope.go:117] "RemoveContainer" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" Sep 06 02:54:48.683660 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.683642 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664"} err="failed to get container status \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": rpc error: code = NotFound desc = could not find container \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": container with ID starting with 8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664 not found: ID does not exist" Sep 06 02:54:48.683707 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.683661 2569 scope.go:117] "RemoveContainer" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" Sep 06 02:54:48.683875 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.683860 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7"} err="failed to get container status \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": rpc error: code = NotFound desc = could not find container \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": container with ID starting with 8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7 not found: ID does not exist" Sep 06 02:54:48.683931 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.683875 2569 scope.go:117] "RemoveContainer" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" Sep 06 02:54:48.684068 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684053 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793"} err="failed to get container status \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": rpc error: code = NotFound desc = could not find container \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": container with ID starting with 394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793 not found: ID does not exist" Sep 06 02:54:48.684116 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684067 2569 scope.go:117] "RemoveContainer" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" Sep 06 02:54:48.684291 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684274 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2"} err="failed to get container status \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": rpc error: code = NotFound desc = could not find container \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": container with ID starting with 7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2 not found: ID does not exist" Sep 06 02:54:48.684338 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684291 2569 scope.go:117] "RemoveContainer" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" Sep 06 02:54:48.684488 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684472 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c"} err="failed to get container status \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": rpc error: code = NotFound desc = could not find container \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": container with ID starting with 55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c not found: ID does not exist" Sep 06 02:54:48.684526 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684489 2569 scope.go:117] "RemoveContainer" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" Sep 06 02:54:48.684685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684670 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b"} err="failed to get container status \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": rpc error: code = NotFound desc = could not find container \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": container with ID starting with ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b not found: ID does not exist" Sep 06 02:54:48.684730 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684684 2569 scope.go:117] "RemoveContainer" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" Sep 06 02:54:48.684897 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684882 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd"} err="failed to get container status \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": rpc error: code = NotFound desc = could not find container \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": container with ID starting with 19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd not found: ID does not exist" Sep 06 02:54:48.684897 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.684896 2569 scope.go:117] "RemoveContainer" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" Sep 06 02:54:48.685109 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.685094 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664"} err="failed to get container status \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": rpc error: code = NotFound desc = could not find container \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": container with ID starting with 8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664 not found: ID does not exist" Sep 06 02:54:48.685161 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.685110 2569 scope.go:117] "RemoveContainer" containerID="8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7" Sep 06 02:54:48.685377 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.685352 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7"} err="failed to get container status \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": rpc error: code = NotFound desc = could not find container \"8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7\": container with ID starting with 8b214f28e8b054635699e0954821a56cce02bad2d234299521da557b0afc0db7 not found: ID does not exist" Sep 06 02:54:48.685377 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.685376 2569 scope.go:117] "RemoveContainer" containerID="394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793" Sep 06 02:54:48.685629 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.685609 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793"} err="failed to get container status \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": rpc error: code = NotFound desc = could not find container \"394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793\": container with ID starting with 394d051b2af1abf63dcd9e23ae1c51bd15899e700539a61b17fd9eee76682793 not found: ID does not exist" Sep 06 02:54:48.685629 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.685626 2569 scope.go:117] "RemoveContainer" containerID="7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2" Sep 06 02:54:48.685886 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.685868 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2"} err="failed to get container status \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": rpc error: code = NotFound desc = could not find container \"7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2\": container with ID starting with 7a19f80901b87c33c27d23d8dce8b3ac10a91aa5b1bb2066a56c03e0377ec7a2 not found: ID does not exist" Sep 06 02:54:48.685886 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.685887 2569 scope.go:117] "RemoveContainer" containerID="55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c" Sep 06 02:54:48.686111 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.686095 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c"} err="failed to get container status \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": rpc error: code = NotFound desc = could not find container \"55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c\": container with ID starting with 55b1c759a1e8efda1388998653352e18c02f5636ffd7a3e713d40a2a9fc5078c not found: ID does not exist" Sep 06 02:54:48.686151 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.686111 2569 scope.go:117] "RemoveContainer" containerID="ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b" Sep 06 02:54:48.686321 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.686301 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b"} err="failed to get container status \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": rpc error: code = NotFound desc = could not find container \"ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b\": container with ID starting with ef8ddd8f81ed4b2a20a1c7e04112956f3ba0de5df4b214fca91cf4107bff493b not found: ID does not exist" Sep 06 02:54:48.686321 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.686319 2569 scope.go:117] "RemoveContainer" containerID="19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd" Sep 06 02:54:48.686545 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.686528 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd"} err="failed to get container status \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": rpc error: code = NotFound desc = could not find container \"19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd\": container with ID starting with 19633966fa848f5de3ecd59f2b95c8b826176bf86bd261c79f046efe2567e2fd not found: ID does not exist" Sep 06 02:54:48.686591 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.686544 2569 scope.go:117] "RemoveContainer" containerID="8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664" Sep 06 02:54:48.686757 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.686740 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664"} err="failed to get container status \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": rpc error: code = NotFound desc = could not find container \"8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664\": container with ID starting with 8537d88438a8429cd8b9291a4bc745234631ec39c586dca75cfc44e039ef3664 not found: ID does not exist" Sep 06 02:54:48.726160 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726132 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-web-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726160 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726157 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726173 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-config\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726186 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726200 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-grpc-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726214 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-config-out\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726227 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726241 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726255 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-db\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726268 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726281 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726294 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-tls-assets\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726307 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726320 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-metrics-client-certs\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726334 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726349 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726363 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-kube-rbac-proxy\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726376 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4f232db-c75c-4c4b-9098-786a83464a49-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726391 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg6x5\" (UniqueName: \"kubernetes.io/projected/d4f232db-c75c-4c4b-9098-786a83464a49-kube-api-access-kg6x5\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.726704 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.726404 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4f232db-c75c-4c4b-9098-786a83464a49-configmap-metrics-client-ca\") on node \"ip-10-0-141-131.ec2.internal\" DevicePath \"\"" Sep 06 02:54:48.926304 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.926272 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:54:48.933327 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.933305 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:54:48.960559 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960535 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:54:48.960820 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960808 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="prometheus" Sep 06 02:54:48.960861 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960822 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="prometheus" Sep 06 02:54:48.960861 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960834 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="thanos-sidecar" Sep 06 02:54:48.960861 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960840 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="thanos-sidecar" Sep 06 02:54:48.960861 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960850 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5aa6044-1c9b-4370-9f2f-301acb247e41" containerName="registry" Sep 06 02:54:48.960861 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960855 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5aa6044-1c9b-4370-9f2f-301acb247e41" containerName="registry" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960861 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="config-reloader" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960868 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="config-reloader" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960875 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy-web" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960880 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy-web" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960887 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2451bbe3-0455-439d-a89d-39a3c8273fc5" containerName="console" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960893 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2451bbe3-0455-439d-a89d-39a3c8273fc5" containerName="console" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960900 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960905 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960911 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="init-config-reloader" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960917 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="init-config-reloader" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960925 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy-thanos" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960930 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy-thanos" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960969 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="thanos-sidecar" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960975 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960981 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2451bbe3-0455-439d-a89d-39a3c8273fc5" containerName="console" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960987 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="config-reloader" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960992 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5aa6044-1c9b-4370-9f2f-301acb247e41" containerName="registry" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.960997 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy-web" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.961002 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="kube-rbac-proxy-thanos" Sep 06 02:54:48.961004 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.961006 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" containerName="prometheus" Sep 06 02:54:48.964041 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.964024 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:48.966875 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.966846 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 06 02:54:48.967183 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967137 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 06 02:54:48.967289 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967216 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 06 02:54:48.967289 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967223 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 06 02:54:48.967500 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967433 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 06 02:54:48.967709 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967688 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 06 02:54:48.967709 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967702 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 06 02:54:48.967896 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967709 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 06 02:54:48.967987 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967971 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9t1gq401p0fqo\"" Sep 06 02:54:48.968059 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.967987 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 06 02:54:48.968059 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.968008 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 06 02:54:48.968168 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.968064 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 06 02:54:48.968168 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.968126 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d6msw\"" Sep 06 02:54:48.968271 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.968253 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 06 02:54:48.974149 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.974130 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 06 02:54:48.975812 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.975790 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 06 02:54:48.982549 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:48.982529 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:54:49.028072 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028042 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-config\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028223 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028078 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028223 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028099 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028223 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028117 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028223 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028153 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028223 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028173 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028225 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028243 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028288 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba67e4ab-7e41-4eff-a707-d51a63131b15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028302 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba67e4ab-7e41-4eff-a707-d51a63131b15-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028318 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp9hg\" (UniqueName: \"kubernetes.io/projected/ba67e4ab-7e41-4eff-a707-d51a63131b15-kube-api-access-hp9hg\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028356 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028395 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028661 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028415 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028661 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028439 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028661 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028453 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028661 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028518 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028661 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028547 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.028661 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.028567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129082 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129032 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129082 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129081 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129317 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129115 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129317 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129142 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129317 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129172 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129317 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129205 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-config\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129317 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129237 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129317 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129264 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129317 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129285 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129317 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129347 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129390 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129413 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129436 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129461 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba67e4ab-7e41-4eff-a707-d51a63131b15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129483 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba67e4ab-7e41-4eff-a707-d51a63131b15-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129511 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp9hg\" (UniqueName: \"kubernetes.io/projected/ba67e4ab-7e41-4eff-a707-d51a63131b15-kube-api-access-hp9hg\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129539 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129605 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.129685 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129651 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.130303 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129762 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.130303 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.129908 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.130415 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.130315 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.130982 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.130955 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.132193 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.132165 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba67e4ab-7e41-4eff-a707-d51a63131b15-config-out\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.132314 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.132252 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.132385 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.132332 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-web-config\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.132442 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.132412 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.132494 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.132461 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.133096 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.133008 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.133096 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.133018 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-config\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.133096 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.133049 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.133838 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.133815 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.133838 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.133823 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.134588 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.134562 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.134684 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.134641 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba67e4ab-7e41-4eff-a707-d51a63131b15-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.134872 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.134853 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ba67e4ab-7e41-4eff-a707-d51a63131b15-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.135534 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.135514 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ba67e4ab-7e41-4eff-a707-d51a63131b15-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.142032 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.142015 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp9hg\" (UniqueName: \"kubernetes.io/projected/ba67e4ab-7e41-4eff-a707-d51a63131b15-kube-api-access-hp9hg\") pod \"prometheus-k8s-0\" (UID: \"ba67e4ab-7e41-4eff-a707-d51a63131b15\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.274554 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.274528 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:54:49.551462 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.551282 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 06 02:54:49.553875 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:54:49.553846 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba67e4ab_7e41_4eff_a707_d51a63131b15.slice/crio-d2232644c83b673e7dcdd8d33810a3fb55c2e37937cc81b3d28fc8d85765946b WatchSource:0}: Error finding container d2232644c83b673e7dcdd8d33810a3fb55c2e37937cc81b3d28fc8d85765946b: Status 404 returned error can't find the container with id d2232644c83b673e7dcdd8d33810a3fb55c2e37937cc81b3d28fc8d85765946b Sep 06 02:54:49.605893 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.605863 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba67e4ab-7e41-4eff-a707-d51a63131b15","Type":"ContainerStarted","Data":"d2232644c83b673e7dcdd8d33810a3fb55c2e37937cc81b3d28fc8d85765946b"} Sep 06 02:54:49.652666 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:49.652636 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f232db-c75c-4c4b-9098-786a83464a49" path="/var/lib/kubelet/pods/d4f232db-c75c-4c4b-9098-786a83464a49/volumes" Sep 06 02:54:50.610258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:50.610164 2569 generic.go:356] "Generic (PLEG): container finished" podID="ba67e4ab-7e41-4eff-a707-d51a63131b15" containerID="9b7732854a30834667493d6f7e1f67a5ef6250d36ae54d04f572a33302720b11" exitCode=0 Sep 06 02:54:50.610258 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:50.610242 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba67e4ab-7e41-4eff-a707-d51a63131b15","Type":"ContainerDied","Data":"9b7732854a30834667493d6f7e1f67a5ef6250d36ae54d04f572a33302720b11"} Sep 06 02:54:51.439411 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:51.439348 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:54:51.617733 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:51.617697 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba67e4ab-7e41-4eff-a707-d51a63131b15","Type":"ContainerStarted","Data":"fa79420b7b184548af829962227da13c872470781f64194b2bdc2092a63b5fdb"} Sep 06 02:54:51.618118 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:51.617812 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba67e4ab-7e41-4eff-a707-d51a63131b15","Type":"ContainerStarted","Data":"7707ea25a8fef7129e8764b72af71cdbb79e0edba29d9d1ae0b79c74bf7806c2"} Sep 06 02:54:51.618118 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:51.617840 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba67e4ab-7e41-4eff-a707-d51a63131b15","Type":"ContainerStarted","Data":"5c8049d4f1860458b6f413f9a977db09062b98728e52a622bb746db245cef9a2"} Sep 06 02:54:51.618118 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:51.617866 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba67e4ab-7e41-4eff-a707-d51a63131b15","Type":"ContainerStarted","Data":"c283355bc68c5ec6934783af03609093c14ff6fc3923618135e58654f60b2d81"} Sep 06 02:54:51.618118 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:51.617889 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba67e4ab-7e41-4eff-a707-d51a63131b15","Type":"ContainerStarted","Data":"1df325c8739e289aaf9c81e9fc19c405344d52b1293b031a28d2a16e28d1766b"} Sep 06 02:54:51.618118 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:51.617922 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ba67e4ab-7e41-4eff-a707-d51a63131b15","Type":"ContainerStarted","Data":"f4ef9cd29844b917953bb089a67ae28de2b80f5f04ec68730ade2b0f38a80249"} Sep 06 02:54:51.648929 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:51.648867 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.625727909 podStartE2EDuration="3.648846808s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.118899ms" isStatefulPod=false podCreationTimestamp="2026-09-06 02:54:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:54:51.646250557 +0000 UTC m=+206.473905979" watchObservedRunningTime="2026-09-06 02:54:51.648846808 +0000 UTC m=+206.476502229" Sep 06 02:54:54.275677 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:54:54.275628 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:55:02.301005 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:02.300966 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:55:02.391854 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:02.391826 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:55:11.855309 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:11.855273 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:55:33.739474 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:33.739434 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:55:33.848162 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:33.848129 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:55:49.275688 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:49.275592 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:55:49.290700 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:49.290676 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:55:49.837452 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:49.837425 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 06 02:55:58.204252 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:58.204210 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:55:58.300719 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:55:58.300674 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:10.054526 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:10.054481 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:10.119199 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:10.119163 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:12.728604 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:12.728566 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:12.829287 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:12.829241 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:22.240633 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:22.240587 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:22.370405 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:22.370374 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:22.426540 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:22.426509 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:22.974728 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:22.974690 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:23.034459 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:23.034422 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:25.589729 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:25.589701 2569 kubelet.go:1648] "Image garbage collection succeeded" Sep 06 02:56:32.815670 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:32.815631 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:32.917228 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:32.917185 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:32.971745 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:32.971709 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:55.680739 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:55.680702 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:56:56.866885 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:56:56.866845 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:02.076378 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:02.076349 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:02.130726 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:02.130695 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:17.401386 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:17.401348 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:18.249950 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:18.249854 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:21.003100 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:21.003071 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:21.071012 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:21.070983 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:23.085315 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:23.085276 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:23.209746 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:23.209710 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:25.458550 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:25.458515 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:25.797992 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:25.797947 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:25.899175 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:25.899146 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:25.956929 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:25.956901 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:32.872450 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:32.872406 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:34.494052 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:34.494020 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:34.557259 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:34.557226 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:35.105467 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:35.105435 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:35.201461 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:35.201425 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:46.424958 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:46.424918 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:46.524049 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:46.524013 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:48.630945 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.630911 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt"] Sep 06 02:57:48.634077 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.634061 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" Sep 06 02:57:48.636982 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.636956 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 06 02:57:48.637093 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.637013 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 06 02:57:48.638387 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.638368 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-txc7l\"" Sep 06 02:57:48.644000 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.643980 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt"] Sep 06 02:57:48.766766 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.766737 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j87js\" (UniqueName: \"kubernetes.io/projected/c2cd4ae8-d219-49b6-bba9-b987286cb387-kube-api-access-j87js\") pod \"jobset-operator-5bc45f897-4wfbt\" (UID: \"c2cd4ae8-d219-49b6-bba9-b987286cb387\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" Sep 06 02:57:48.766907 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.766790 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2cd4ae8-d219-49b6-bba9-b987286cb387-tmp\") pod \"jobset-operator-5bc45f897-4wfbt\" (UID: \"c2cd4ae8-d219-49b6-bba9-b987286cb387\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" Sep 06 02:57:48.868057 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.868025 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87js\" (UniqueName: \"kubernetes.io/projected/c2cd4ae8-d219-49b6-bba9-b987286cb387-kube-api-access-j87js\") pod \"jobset-operator-5bc45f897-4wfbt\" (UID: \"c2cd4ae8-d219-49b6-bba9-b987286cb387\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" Sep 06 02:57:48.868180 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.868062 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2cd4ae8-d219-49b6-bba9-b987286cb387-tmp\") pod \"jobset-operator-5bc45f897-4wfbt\" (UID: \"c2cd4ae8-d219-49b6-bba9-b987286cb387\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" Sep 06 02:57:48.868485 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.868466 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2cd4ae8-d219-49b6-bba9-b987286cb387-tmp\") pod \"jobset-operator-5bc45f897-4wfbt\" (UID: \"c2cd4ae8-d219-49b6-bba9-b987286cb387\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" Sep 06 02:57:48.876628 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.876606 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j87js\" (UniqueName: \"kubernetes.io/projected/c2cd4ae8-d219-49b6-bba9-b987286cb387-kube-api-access-j87js\") pod \"jobset-operator-5bc45f897-4wfbt\" (UID: \"c2cd4ae8-d219-49b6-bba9-b987286cb387\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" Sep 06 02:57:48.958108 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:48.958046 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" Sep 06 02:57:49.226497 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:49.226473 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt"] Sep 06 02:57:49.228790 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:57:49.228745 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2cd4ae8_d219_49b6_bba9_b987286cb387.slice/crio-ab0252fad6da29cd1d1e3e73c3fa5e0805b826d13669763a4d5b0433e7edd316 WatchSource:0}: Error finding container ab0252fad6da29cd1d1e3e73c3fa5e0805b826d13669763a4d5b0433e7edd316: Status 404 returned error can't find the container with id ab0252fad6da29cd1d1e3e73c3fa5e0805b826d13669763a4d5b0433e7edd316 Sep 06 02:57:49.230286 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:49.230266 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 02:57:49.248014 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:49.247982 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" event={"ID":"c2cd4ae8-d219-49b6-bba9-b987286cb387","Type":"ContainerStarted","Data":"ab0252fad6da29cd1d1e3e73c3fa5e0805b826d13669763a4d5b0433e7edd316"} Sep 06 02:57:53.264190 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:53.264150 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" event={"ID":"c2cd4ae8-d219-49b6-bba9-b987286cb387","Type":"ContainerStarted","Data":"30c2624ad9c37bc95a61b672509382ade43915aa4e9921d86f9ba0af953d893c"} Sep 06 02:57:56.411191 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:56.411158 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:56.813864 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:56.813827 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:56.876255 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:56.876215 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:57:58.643208 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:57:58.643177 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:04.697500 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:04.697462 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:04.765845 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:04.765805 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:04.851216 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:04.851173 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:04.911725 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:04.911694 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:05.440753 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:05.440709 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:12.267999 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:12.267957 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:15.215531 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:15.215490 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:15.268271 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:15.268236 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:15.332285 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:15.332249 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:46.902182 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:46.902146 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:47.003644 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:47.003604 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:47.419884 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:47.419831 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:58:47.703626 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:58:47.703532 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:21.682236 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:21.682199 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:21.754767 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:21.754732 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:32.374470 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:32.374423 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:32.474756 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:32.474726 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:35.030966 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.030932 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:35.059560 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.059509 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-4wfbt" podStartSLOduration=104.06683411 podStartE2EDuration="1m47.059492504s" totalImagesPullingTime="2.992658394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:57:53.285483751 +0000 UTC m=+388.113139172" watchObservedRunningTime="2026-09-06 02:59:35.059492504 +0000 UTC m=+489.887147924" Sep 06 02:59:35.059926 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.059910 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg"] Sep 06 02:59:35.063137 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.063120 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.066039 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.066020 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 06 02:59:35.066039 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.066020 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Sep 06 02:59:35.066921 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.066906 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Sep 06 02:59:35.067073 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.067057 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-m26hx\"" Sep 06 02:59:35.067126 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.067083 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 06 02:59:35.071764 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.071744 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg"] Sep 06 02:59:35.097062 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.097042 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3c6c17d4-3185-401e-ae69-4711f00b087b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.097153 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.097074 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c6c17d4-3185-401e-ae69-4711f00b087b-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.097195 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.097144 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2w6n\" (UniqueName: \"kubernetes.io/projected/3c6c17d4-3185-401e-ae69-4711f00b087b-kube-api-access-n2w6n\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.197890 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.197867 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2w6n\" (UniqueName: \"kubernetes.io/projected/3c6c17d4-3185-401e-ae69-4711f00b087b-kube-api-access-n2w6n\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.198008 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.197916 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3c6c17d4-3185-401e-ae69-4711f00b087b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.198008 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.197945 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c6c17d4-3185-401e-ae69-4711f00b087b-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.198599 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.198579 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/3c6c17d4-3185-401e-ae69-4711f00b087b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.200393 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.200373 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c6c17d4-3185-401e-ae69-4711f00b087b-cert\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.207917 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.207895 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2w6n\" (UniqueName: \"kubernetes.io/projected/3c6c17d4-3185-401e-ae69-4711f00b087b-kube-api-access-n2w6n\") pod \"kubeflow-trainer-controller-manager-7f9b886978-sshbg\" (UID: \"3c6c17d4-3185-401e-ae69-4711f00b087b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.343287 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.343221 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:35.373044 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.373021 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:35.446025 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.445966 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:35.642040 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:35.641971 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg"] Sep 06 02:59:35.645694 ip-10-0-141-131 kubenswrapper[2569]: W0906 02:59:35.645660 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c6c17d4_3185_401e_ae69_4711f00b087b.slice/crio-9d8312b17670c1fa0b546dadc6a3259c1e77daf4c002b3f5714e2b970050ec38 WatchSource:0}: Error finding container 9d8312b17670c1fa0b546dadc6a3259c1e77daf4c002b3f5714e2b970050ec38: Status 404 returned error can't find the container with id 9d8312b17670c1fa0b546dadc6a3259c1e77daf4c002b3f5714e2b970050ec38 Sep 06 02:59:36.653409 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:36.653368 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" event={"ID":"3c6c17d4-3185-401e-ae69-4711f00b087b","Type":"ContainerStarted","Data":"9d8312b17670c1fa0b546dadc6a3259c1e77daf4c002b3f5714e2b970050ec38"} Sep 06 02:59:38.479976 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:38.479943 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:38.538916 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:38.538883 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 02:59:38.663787 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:38.663747 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" event={"ID":"3c6c17d4-3185-401e-ae69-4711f00b087b","Type":"ContainerStarted","Data":"5b7031445800472968a0960b63b337b45060f0643686c52f50d7ea374fed7698"} Sep 06 02:59:38.663950 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:38.663882 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 02:59:38.682199 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:38.682157 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" podStartSLOduration=1.478916264 podStartE2EDuration="3.68214501s" totalImagesPullingTime="2.203228746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 02:59:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 02:59:38.68049665 +0000 UTC m=+493.508152070" watchObservedRunningTime="2026-09-06 02:59:38.68214501 +0000 UTC m=+493.509800427" Sep 06 02:59:54.671966 ip-10-0-141-131 kubenswrapper[2569]: I0906 02:59:54.671936 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7f9b886978-sshbg" Sep 06 03:00:41.606105 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:00:41.606022 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:00:41.671783 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:00:41.671742 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:01:13.869809 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:01:13.869752 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:01:13.924799 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:01:13.924749 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:01:14.737426 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:01:14.737391 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:03:09.915429 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:03:09.915395 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:03:11.092565 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:03:11.092529 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:03:17.682298 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:03:17.682265 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:04:49.754439 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:04:49.754354 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:05:07.222845 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:05:07.222804 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:05:07.275051 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:05:07.275020 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:05:31.211442 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:05:31.211408 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:05:31.274128 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:05:31.274093 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:05:47.591349 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:05:47.591313 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-sshbg_3c6c17d4-3185-401e-ae69-4711f00b087b/manager/0.log" Sep 06 03:05:48.053314 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:05:48.053286 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-sshbg_3c6c17d4-3185-401e-ae69-4711f00b087b/manager/0.log" Sep 06 03:05:48.505329 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:05:48.505299 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-7f9b886978-sshbg_3c6c17d4-3185-401e-ae69-4711f00b087b/manager/0.log" Sep 06 03:06:24.804536 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:24.804453 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:06:24.933032 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:24.932993 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h9mmr/must-gather-snnf4"] Sep 06 03:06:24.936328 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:24.936305 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h9mmr/must-gather-snnf4" Sep 06 03:06:24.939149 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:24.939127 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h9mmr\"/\"openshift-service-ca.crt\"" Sep 06 03:06:24.940371 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:24.940354 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h9mmr\"/\"default-dockercfg-m9qtg\"" Sep 06 03:06:24.940479 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:24.940441 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h9mmr\"/\"kube-root-ca.crt\"" Sep 06 03:06:24.945883 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:24.945862 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h9mmr/must-gather-snnf4"] Sep 06 03:06:24.947590 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:24.947564 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:06:25.044828 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.044755 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:06:25.079090 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.079002 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brzht\" (UniqueName: \"kubernetes.io/projected/0bae49b4-aa45-4986-88d1-e280c3c79327-kube-api-access-brzht\") pod \"must-gather-snnf4\" (UID: \"0bae49b4-aa45-4986-88d1-e280c3c79327\") " pod="openshift-must-gather-h9mmr/must-gather-snnf4" Sep 06 03:06:25.079228 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.079101 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0bae49b4-aa45-4986-88d1-e280c3c79327-must-gather-output\") pod \"must-gather-snnf4\" (UID: \"0bae49b4-aa45-4986-88d1-e280c3c79327\") " pod="openshift-must-gather-h9mmr/must-gather-snnf4" Sep 06 03:06:25.179632 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.179594 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brzht\" (UniqueName: \"kubernetes.io/projected/0bae49b4-aa45-4986-88d1-e280c3c79327-kube-api-access-brzht\") pod \"must-gather-snnf4\" (UID: \"0bae49b4-aa45-4986-88d1-e280c3c79327\") " pod="openshift-must-gather-h9mmr/must-gather-snnf4" Sep 06 03:06:25.179850 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.179681 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0bae49b4-aa45-4986-88d1-e280c3c79327-must-gather-output\") pod \"must-gather-snnf4\" (UID: \"0bae49b4-aa45-4986-88d1-e280c3c79327\") " pod="openshift-must-gather-h9mmr/must-gather-snnf4" Sep 06 03:06:25.180057 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.180037 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0bae49b4-aa45-4986-88d1-e280c3c79327-must-gather-output\") pod \"must-gather-snnf4\" (UID: \"0bae49b4-aa45-4986-88d1-e280c3c79327\") " pod="openshift-must-gather-h9mmr/must-gather-snnf4" Sep 06 03:06:25.188440 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.188412 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brzht\" (UniqueName: \"kubernetes.io/projected/0bae49b4-aa45-4986-88d1-e280c3c79327-kube-api-access-brzht\") pod \"must-gather-snnf4\" (UID: \"0bae49b4-aa45-4986-88d1-e280c3c79327\") " pod="openshift-must-gather-h9mmr/must-gather-snnf4" Sep 06 03:06:25.246297 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.246260 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h9mmr/must-gather-snnf4" Sep 06 03:06:25.517428 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.517402 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h9mmr/must-gather-snnf4"] Sep 06 03:06:25.519943 ip-10-0-141-131 kubenswrapper[2569]: W0906 03:06:25.519911 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bae49b4_aa45_4986_88d1_e280c3c79327.slice/crio-ff6967aa41c2565282c20fce4c4befba70779da27189b92880f051ef138b79a4 WatchSource:0}: Error finding container ff6967aa41c2565282c20fce4c4befba70779da27189b92880f051ef138b79a4: Status 404 returned error can't find the container with id ff6967aa41c2565282c20fce4c4befba70779da27189b92880f051ef138b79a4 Sep 06 03:06:25.521810 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:25.521795 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 06 03:06:26.140866 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:26.140826 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9mmr/must-gather-snnf4" event={"ID":"0bae49b4-aa45-4986-88d1-e280c3c79327","Type":"ContainerStarted","Data":"ff6967aa41c2565282c20fce4c4befba70779da27189b92880f051ef138b79a4"} Sep 06 03:06:27.147853 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:27.147813 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9mmr/must-gather-snnf4" event={"ID":"0bae49b4-aa45-4986-88d1-e280c3c79327","Type":"ContainerStarted","Data":"3e984ce85826ff75538fce9af31f625126ca948d8d3f1fceec960dc20243732c"} Sep 06 03:06:27.148295 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:27.147864 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9mmr/must-gather-snnf4" event={"ID":"0bae49b4-aa45-4986-88d1-e280c3c79327","Type":"ContainerStarted","Data":"55844e624fe821b001c6c9792b82f8f533a9f9499663898be99ce1963993cd86"} Sep 06 03:06:27.165635 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:27.165558 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h9mmr/must-gather-snnf4" podStartSLOduration=2.471124453 podStartE2EDuration="3.165535511s" totalImagesPullingTime="694.411058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 03:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 03:06:27.163959449 +0000 UTC m=+901.991614865" watchObservedRunningTime="2026-09-06 03:06:27.165535511 +0000 UTC m=+901.993190946" Sep 06 03:06:27.573069 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:27.573042 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lskvr_5e9feeee-1c3b-4713-90e0-420ee974061f/global-pull-secret-syncer/0.log" Sep 06 03:06:27.693640 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:27.693593 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" Sep 06 03:06:27.819871 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:27.819841 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-131.ec2.internal_730a0a3e5dc7d84e9d63b6685c537c58/haproxy/0.log" Sep 06 03:06:30.360136 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:30.360098 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:06:30.416949 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:30.416902 2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-49wmq_b492b042-19d0-4186-a1ba-e2917f07b09b/konnectivity-agent/0.log" limit=1024 Sep 06 03:06:31.949200 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:31.949146 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fg4xr_ad582415-9947-419e-9c31-3418498fff62/kube-state-metrics/0.log" Sep 06 03:06:31.973323 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:31.973290 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fg4xr_ad582415-9947-419e-9c31-3418498fff62/kube-rbac-proxy-main/0.log" Sep 06 03:06:32.002374 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.002336 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-fg4xr_ad582415-9947-419e-9c31-3418498fff62/kube-rbac-proxy-self/0.log" Sep 06 03:06:32.037893 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.037832 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b8665756c-2qh8g_f2074178-13ab-4105-9236-c04f9394e3f3/metrics-server/0.log" Sep 06 03:06:32.102148 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.102120 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqcdz_80bab8b7-d52a-4989-b876-d867529df6ba/node-exporter/0.log" Sep 06 03:06:32.128171 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.128083 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqcdz_80bab8b7-d52a-4989-b876-d867529df6ba/kube-rbac-proxy/0.log" Sep 06 03:06:32.155848 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.155817 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lqcdz_80bab8b7-d52a-4989-b876-d867529df6ba/init-textfile/0.log" Sep 06 03:06:32.378277 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.378200 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-4shzw_3d83f330-e173-4854-b059-a9cd17f6705b/kube-rbac-proxy-main/0.log" Sep 06 03:06:32.402946 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.402919 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-4shzw_3d83f330-e173-4854-b059-a9cd17f6705b/kube-rbac-proxy-self/0.log" Sep 06 03:06:32.428112 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.428085 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-4shzw_3d83f330-e173-4854-b059-a9cd17f6705b/openshift-state-metrics/0.log" Sep 06 03:06:32.470359 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.470332 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba67e4ab-7e41-4eff-a707-d51a63131b15/prometheus/0.log" Sep 06 03:06:32.498591 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.498562 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba67e4ab-7e41-4eff-a707-d51a63131b15/config-reloader/0.log" Sep 06 03:06:32.526455 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.526392 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba67e4ab-7e41-4eff-a707-d51a63131b15/thanos-sidecar/0.log" Sep 06 03:06:32.554223 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.554194 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba67e4ab-7e41-4eff-a707-d51a63131b15/kube-rbac-proxy-web/0.log" Sep 06 03:06:32.593066 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.593034 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba67e4ab-7e41-4eff-a707-d51a63131b15/kube-rbac-proxy/0.log" Sep 06 03:06:32.620150 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.620123 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba67e4ab-7e41-4eff-a707-d51a63131b15/kube-rbac-proxy-thanos/0.log" Sep 06 03:06:32.650397 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.650319 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ba67e4ab-7e41-4eff-a707-d51a63131b15/init-config-reloader/0.log" Sep 06 03:06:32.687224 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.687195 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-84kts_22b0771c-68be-409b-b5f4-f9e52eeef6f4/prometheus-operator/0.log" Sep 06 03:06:32.706016 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:32.705989 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-84kts_22b0771c-68be-409b-b5f4-f9e52eeef6f4/kube-rbac-proxy/0.log" Sep 06 03:06:35.068170 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.068135 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-pg9zc_0ea0c2c3-2e58-4d4a-a061-6f831544d122/download-server/0.log" Sep 06 03:06:35.247290 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.247251 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl"] Sep 06 03:06:35.253388 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.253360 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.258580 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.258548 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl"] Sep 06 03:06:35.381464 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.381427 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn5t9\" (UniqueName: \"kubernetes.io/projected/2461c8db-ff8e-405b-aba2-6269e690339f-kube-api-access-gn5t9\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.381659 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.381486 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-proc\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.381659 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.381548 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-sys\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.381659 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.381566 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-podres\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.381659 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.381599 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-lib-modules\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.482281 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.482242 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-lib-modules\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.482535 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.482516 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn5t9\" (UniqueName: \"kubernetes.io/projected/2461c8db-ff8e-405b-aba2-6269e690339f-kube-api-access-gn5t9\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.482702 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.482686 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-proc\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.482901 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.482885 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-sys\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.483022 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.483006 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-podres\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.483126 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.483102 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-proc\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.483191 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.482555 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-lib-modules\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.483251 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.483052 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-sys\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.483458 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.483437 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2461c8db-ff8e-405b-aba2-6269e690339f-podres\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.490920 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.490896 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn5t9\" (UniqueName: \"kubernetes.io/projected/2461c8db-ff8e-405b-aba2-6269e690339f-kube-api-access-gn5t9\") pod \"perf-node-gather-daemonset-j8lxl\" (UID: \"2461c8db-ff8e-405b-aba2-6269e690339f\") " pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.567389 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.567288 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:35.859197 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:35.858379 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl"] Sep 06 03:06:35.864043 ip-10-0-141-131 kubenswrapper[2569]: W0906 03:06:35.864011 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2461c8db_ff8e_405b_aba2_6269e690339f.slice/crio-0c6b5f1bf4bcbbb2eef4cb232b9f3198c156d0a02d7dce399662b2969e81e43e WatchSource:0}: Error finding container 0c6b5f1bf4bcbbb2eef4cb232b9f3198c156d0a02d7dce399662b2969e81e43e: Status 404 returned error can't find the container with id 0c6b5f1bf4bcbbb2eef4cb232b9f3198c156d0a02d7dce399662b2969e81e43e Sep 06 03:06:36.207811 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:36.207691 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" event={"ID":"2461c8db-ff8e-405b-aba2-6269e690339f","Type":"ContainerStarted","Data":"28931c1710fbfe12d306e1a47f3d0c37acb6c8dabb4bdb28745add673af59ff7"} Sep 06 03:06:36.207811 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:36.207744 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" event={"ID":"2461c8db-ff8e-405b-aba2-6269e690339f","Type":"ContainerStarted","Data":"0c6b5f1bf4bcbbb2eef4cb232b9f3198c156d0a02d7dce399662b2969e81e43e"} Sep 06 03:06:36.207811 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:36.207783 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:36.226666 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:36.226613 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" podStartSLOduration=1.226597094 podStartE2EDuration="1.226597094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 03:06:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 03:06:36.224850944 +0000 UTC m=+911.052506365" watchObservedRunningTime="2026-09-06 03:06:36.226597094 +0000 UTC m=+911.054252514" Sep 06 03:06:36.441139 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:36.441114 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7fjgw_b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab/dns/0.log" Sep 06 03:06:36.462576 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:36.462475 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7fjgw_b64fc2f4-2ab0-4e22-9219-ea71b8dbb1ab/kube-rbac-proxy/0.log" Sep 06 03:06:36.583096 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:36.583060 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-th72l_255dee4d-6ebc-4384-9f76-d004209a3ac0/dns-node-resolver/0.log" Sep 06 03:06:37.001697 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:37.001671 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t2whv_74b8b94d-ef8b-4297-9c82-ba364256fa95/node-ca/0.log" Sep 06 03:06:37.795484 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:37.795442 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c55c8c9b8-fjdpz_5c084985-b273-4d55-90b6-79222607449a/router/0.log" Sep 06 03:06:38.141386 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:38.141310 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f2b82_e4f4929c-b0b9-497a-813f-567dded7f91c/serve-healthcheck-canary/0.log" Sep 06 03:06:38.523628 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:38.523599 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hbvb_c8d3bb5d-8dd7-43a2-b136-46aa93879681/kube-rbac-proxy/0.log" Sep 06 03:06:38.546308 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:38.546282 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hbvb_c8d3bb5d-8dd7-43a2-b136-46aa93879681/exporter/0.log" Sep 06 03:06:38.572727 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:38.572702 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hbvb_c8d3bb5d-8dd7-43a2-b136-46aa93879681/extractor/0.log" Sep 06 03:06:40.385923 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:40.385889 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-4wfbt_c2cd4ae8-d219-49b6-bba9-b987286cb387/jobset-operator/0.log" Sep 06 03:06:42.224465 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:42.224426 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h9mmr/perf-node-gather-daemonset-j8lxl" Sep 06 03:06:45.154765 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.154682 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6sgk9_ed7824d5-86f7-4475-ace5-1507ff0c3c47/kube-multus/0.log" Sep 06 03:06:45.349285 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.349256 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm76v_e35e2b20-920f-4d3b-858e-642153ec251a/kube-multus-additional-cni-plugins/0.log" Sep 06 03:06:45.373959 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.373930 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm76v_e35e2b20-920f-4d3b-858e-642153ec251a/egress-router-binary-copy/0.log" Sep 06 03:06:45.397511 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.397468 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm76v_e35e2b20-920f-4d3b-858e-642153ec251a/cni-plugins/0.log" Sep 06 03:06:45.423012 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.422940 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm76v_e35e2b20-920f-4d3b-858e-642153ec251a/bond-cni-plugin/0.log" Sep 06 03:06:45.445950 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.445929 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm76v_e35e2b20-920f-4d3b-858e-642153ec251a/routeoverride-cni/0.log" Sep 06 03:06:45.468633 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.468607 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm76v_e35e2b20-920f-4d3b-858e-642153ec251a/whereabouts-cni-bincopy/0.log" Sep 06 03:06:45.490434 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.490396 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm76v_e35e2b20-920f-4d3b-858e-642153ec251a/whereabouts-cni/0.log" Sep 06 03:06:45.855385 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.855338 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ns26g_8b26ede6-74e1-428a-b8bb-15ad8032380a/network-metrics-daemon/0.log" Sep 06 03:06:45.879537 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:45.879507 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ns26g_8b26ede6-74e1-428a-b8bb-15ad8032380a/kube-rbac-proxy/0.log" Sep 06 03:06:46.684868 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:46.684791 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd8jj_fda1e155-d697-4ae3-9960-645af0f169e2/ovn-controller/0.log" Sep 06 03:06:46.723447 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:46.723420 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd8jj_fda1e155-d697-4ae3-9960-645af0f169e2/ovn-acl-logging/0.log" Sep 06 03:06:46.767621 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:46.767590 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd8jj_fda1e155-d697-4ae3-9960-645af0f169e2/kube-rbac-proxy-node/0.log" Sep 06 03:06:46.809237 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:46.809212 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd8jj_fda1e155-d697-4ae3-9960-645af0f169e2/kube-rbac-proxy-ovn-metrics/0.log" Sep 06 03:06:46.850981 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:46.850946 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd8jj_fda1e155-d697-4ae3-9960-645af0f169e2/northd/0.log" Sep 06 03:06:46.894578 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:46.894544 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd8jj_fda1e155-d697-4ae3-9960-645af0f169e2/nbdb/0.log" Sep 06 03:06:46.936815 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:46.936718 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd8jj_fda1e155-d697-4ae3-9960-645af0f169e2/sbdb/0.log" Sep 06 03:06:46.993091 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:46.993057 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cd8jj_fda1e155-d697-4ae3-9960-645af0f169e2/ovnkube-controller/0.log" Sep 06 03:06:48.627977 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:48.627948 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9vd9k_c3e1dd0b-14f8-49eb-a085-2883236a1af5/network-check-target-container/0.log" Sep 06 03:06:49.578187 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:49.578151 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-klc96_cd61d73b-ea22-4a94-ba88-ae9995156558/iptables-alerter/0.log" Sep 06 03:06:50.161432 ip-10-0-141-131 kubenswrapper[2569]: I0906 03:06:50.161404 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rfg5q_7da900d7-d73e-4c65-a0d6-c58615da7c53/tuned/0.log"