Sep 18 02:55:53.915409 ip-10-0-134-53 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 18 02:55:53.915420 ip-10-0-134-53 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 18 02:55:53.915427 ip-10-0-134-53 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 18 02:55:53.915677 ip-10-0-134-53 systemd[1]: Failed to start Kubernetes Kubelet. Sep 18 02:56:03.519149 ip-10-0-134-53 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Sep 18 02:56:03.519159 ip-10-0-134-53 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6e097cfbbd934179b7ea93b67a4f665a -- Sep 18 02:57:59.330788 ip-10-0-134-53 systemd[1]: Starting Kubernetes Kubelet... Sep 18 02:58:02.996212 ip-10-0-134-53 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 02:58:02.996212 ip-10-0-134-53 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 18 02:58:02.996212 ip-10-0-134-53 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 02:58:02.996212 ip-10-0-134-53 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 18 02:58:02.996212 ip-10-0-134-53 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 18 02:58:02.997036 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:02.996284 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 18 02:58:03.001508 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001475 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 02:58:03.001508 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001507 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001511 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001515 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001518 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001521 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001525 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001528 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001531 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001535 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001538 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001541 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001544 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001547 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001550 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001553 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001556 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001566 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001570 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001573 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001576 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001579 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 02:58:03.001580 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001582 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001585 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001589 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001592 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001595 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001598 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001601 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001604 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001607 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001610 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001613 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001615 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001618 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001621 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001624 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001627 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001629 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001632 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001635 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001638 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 02:58:03.002124 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001641 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001644 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001647 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001649 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001652 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001655 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001658 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001661 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001664 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001667 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001670 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001672 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001675 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001678 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001681 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001684 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001687 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001690 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001693 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001696 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 02:58:03.002665 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001699 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001702 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001704 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001709 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001712 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001716 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001719 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001722 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001724 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001727 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001730 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001733 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001736 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001740 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001743 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001746 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001749 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001752 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001758 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 02:58:03.003213 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001762 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001765 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001767 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001770 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001773 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001776 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001778 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001784 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001788 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001791 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001794 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001797 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001801 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001804 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001807 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001810 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001813 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.001816 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002573 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 02:58:03.003723 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002580 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002584 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002588 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002591 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002594 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002598 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002601 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002604 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002608 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002611 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002615 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002618 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002621 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002624 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002627 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002630 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002633 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002637 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002640 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002643 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 02:58:03.004252 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002647 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002650 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002653 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002655 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002658 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002661 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002664 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002667 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002670 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002673 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002675 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002678 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002681 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002684 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002687 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002690 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002692 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002695 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002698 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 02:58:03.005014 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002704 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002708 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002712 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002715 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002718 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002720 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002724 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002726 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002729 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002732 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002735 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002737 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002741 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002744 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002747 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002750 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002753 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002755 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002758 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002761 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 02:58:03.005675 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002764 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002767 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002769 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002772 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002775 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002778 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002781 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002783 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002786 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002789 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002792 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002795 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002797 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002800 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002803 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002806 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002809 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002812 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002817 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 02:58:03.006348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002820 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002825 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002828 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002832 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002835 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002838 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002841 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002844 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002847 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002850 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002853 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002855 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002858 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002861 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002864 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002867 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002870 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002873 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002875 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.002878 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 02:58:03.006918 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003259 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003264 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003267 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003270 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003273 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003277 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003281 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003284 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003288 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003290 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003294 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003297 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003299 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003302 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003307 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003310 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003313 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003316 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003319 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003322 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 02:58:03.007575 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003325 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003328 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003331 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003334 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003337 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003340 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003343 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003345 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003348 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003351 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003353 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003356 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003359 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003361 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003364 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003367 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003370 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003372 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003375 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003378 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 02:58:03.008232 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003380 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003384 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003386 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003389 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003392 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003395 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003399 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003402 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003405 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003411 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003415 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003418 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003422 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003425 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003428 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003431 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003433 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003436 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003439 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 02:58:03.008778 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003442 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003444 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003447 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003450 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003453 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003456 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003458 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003461 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003465 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003468 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003470 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003473 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003476 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003480 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003497 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003501 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003504 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003508 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003511 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 02:58:03.009368 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003515 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003518 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003521 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003524 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003527 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003530 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003532 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003535 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003538 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003541 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003543 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003546 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003549 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003552 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003555 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003558 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003560 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003563 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003566 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003569 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.003571 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 02:58:03.009885 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003648 2575 flags.go:64] FLAG: --address="0.0.0.0" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003682 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003689 2575 flags.go:64] FLAG: --anonymous-auth="true" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003694 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003698 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003702 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003706 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003710 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003715 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003718 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003722 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003728 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003732 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003735 2575 flags.go:64] FLAG: --cgroup-root="" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003739 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003742 2575 flags.go:64] FLAG: --client-ca-file="" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003745 2575 flags.go:64] FLAG: --cloud-provider="external" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003748 2575 flags.go:64] FLAG: --cluster-dns="[]" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003753 2575 flags.go:64] FLAG: --cluster-domain="" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003756 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003759 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003763 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003766 2575 flags.go:64] FLAG: --container-log-max-files="5" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003770 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 18 02:58:03.010472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003774 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003777 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003780 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003783 2575 flags.go:64] FLAG: --contention-profiling="false" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003786 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003790 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003793 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003796 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003803 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003808 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003811 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003814 2575 flags.go:64] FLAG: --enable-load-reader="false" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003818 2575 flags.go:64] FLAG: --enable-server="true" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003821 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003826 2575 flags.go:64] FLAG: --event-burst="100" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003829 2575 flags.go:64] FLAG: --event-qps="50" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003832 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003836 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003839 2575 flags.go:64] FLAG: --eviction-hard="" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003844 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003848 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003851 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003854 2575 flags.go:64] FLAG: --eviction-soft="" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003857 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003860 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 18 02:58:03.011180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003863 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003866 2575 flags.go:64] FLAG: --experimental-mounter-path="" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003869 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003872 2575 flags.go:64] FLAG: --fail-swap-on="true" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003875 2575 flags.go:64] FLAG: --feature-gates="" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003879 2575 flags.go:64] FLAG: --file-check-frequency="20s" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003882 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003886 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003889 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003892 2575 flags.go:64] FLAG: --healthz-port="10248" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003895 2575 flags.go:64] FLAG: --help="false" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003898 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003902 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003905 2575 flags.go:64] FLAG: --http-check-frequency="20s" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003908 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003912 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003917 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003920 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003923 2575 flags.go:64] FLAG: --image-service-endpoint="" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003926 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003930 2575 flags.go:64] FLAG: --kube-api-burst="100" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003932 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003936 2575 flags.go:64] FLAG: --kube-api-qps="50" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003939 2575 flags.go:64] FLAG: --kube-reserved="" Sep 18 02:58:03.011906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003942 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003945 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003950 2575 flags.go:64] FLAG: --kubelet-cgroups="" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003953 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003956 2575 flags.go:64] FLAG: --lock-file="" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003959 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003962 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003965 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003971 2575 flags.go:64] FLAG: --log-json-split-stream="false" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003974 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003977 2575 flags.go:64] FLAG: --log-text-split-stream="false" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003980 2575 flags.go:64] FLAG: --logging-format="text" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003983 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003986 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003990 2575 flags.go:64] FLAG: --manifest-url="" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003993 2575 flags.go:64] FLAG: --manifest-url-header="" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.003997 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004000 2575 flags.go:64] FLAG: --max-open-files="1000000" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004004 2575 flags.go:64] FLAG: --max-pods="110" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004007 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004011 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004014 2575 flags.go:64] FLAG: --memory-manager-policy="None" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004017 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004020 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004026 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 18 02:58:03.012574 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004029 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004036 2575 flags.go:64] FLAG: --node-status-max-images="50" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004039 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004042 2575 flags.go:64] FLAG: --oom-score-adj="-999" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004046 2575 flags.go:64] FLAG: --pod-cidr="" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004049 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004053 2575 flags.go:64] FLAG: --pod-manifest-path="" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004057 2575 flags.go:64] FLAG: --pod-max-pids="-1" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004060 2575 flags.go:64] FLAG: --pods-per-core="0" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004063 2575 flags.go:64] FLAG: --port="10250" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004068 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004071 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-036645c2616f36f4b" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004075 2575 flags.go:64] FLAG: --qos-reserved="" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004078 2575 flags.go:64] FLAG: --read-only-port="10255" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004081 2575 flags.go:64] FLAG: --register-node="true" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004084 2575 flags.go:64] FLAG: --register-with-taints="" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004088 2575 flags.go:64] FLAG: --registry-burst="10" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004091 2575 flags.go:64] FLAG: --registry-qps="5" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004094 2575 flags.go:64] FLAG: --reserved-cpus="" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004097 2575 flags.go:64] FLAG: --reserved-memory="" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004101 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004104 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004107 2575 flags.go:64] FLAG: --rotate-certificates="false" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004110 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004113 2575 flags.go:64] FLAG: --runonce="false" Sep 18 02:58:03.013226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004117 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004120 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004123 2575 flags.go:64] FLAG: --seccomp-default="false" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004126 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004129 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004132 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004137 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004140 2575 flags.go:64] FLAG: --storage-driver-password="root" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004143 2575 flags.go:64] FLAG: --storage-driver-secure="false" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004146 2575 flags.go:64] FLAG: --storage-driver-table="stats" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004149 2575 flags.go:64] FLAG: --storage-driver-user="root" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004152 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004155 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004158 2575 flags.go:64] FLAG: --system-cgroups="" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004161 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004167 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004170 2575 flags.go:64] FLAG: --tls-cert-file="" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004175 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004180 2575 flags.go:64] FLAG: --tls-min-version="" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004183 2575 flags.go:64] FLAG: --tls-private-key-file="" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004186 2575 flags.go:64] FLAG: --topology-manager-policy="none" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004189 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004192 2575 flags.go:64] FLAG: --topology-manager-scope="container" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004195 2575 flags.go:64] FLAG: --v="2" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004199 2575 flags.go:64] FLAG: --version="false" Sep 18 02:58:03.013953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004203 2575 flags.go:64] FLAG: --vmodule="" Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004207 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.004211 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004651 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004664 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004670 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004675 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004680 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004685 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004690 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004695 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004702 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004709 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004716 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004721 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004732 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004737 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004742 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004747 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 02:58:03.014646 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004752 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004757 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004762 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004767 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004771 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004778 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004784 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004788 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004798 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004803 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004808 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004812 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004817 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004822 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004826 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004831 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004836 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004840 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004845 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004850 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 02:58:03.015153 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004854 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004863 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004868 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004872 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004877 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004882 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004888 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004893 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004898 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004903 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004908 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004912 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004917 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004922 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004932 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004936 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004941 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004947 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004952 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004958 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 02:58:03.015698 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004963 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004968 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004972 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004977 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004982 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004987 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.004997 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005002 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005008 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005015 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005020 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005025 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005029 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005035 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005039 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005046 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005052 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005057 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005068 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 02:58:03.016226 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005074 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005080 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005084 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005089 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005094 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005098 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005104 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005108 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005113 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005118 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005125 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005130 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005140 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005146 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005150 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005155 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005160 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005165 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005169 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005173 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 02:58:03.016768 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005178 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005182 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005187 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.005192 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.005835 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.013705 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.013720 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.013740 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.013745 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013799 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013804 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013808 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013812 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013815 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 02:58:03.017311 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013818 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013821 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013824 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013828 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013830 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013833 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013836 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013839 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013842 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013846 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013849 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013852 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013855 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013858 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013861 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013864 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013867 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013870 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013873 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013876 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 02:58:03.017748 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013878 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013882 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013885 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013887 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013890 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013893 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013896 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013898 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013901 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013904 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013907 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013910 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013913 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013915 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013918 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013921 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013924 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013927 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013930 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013933 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 02:58:03.018271 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013936 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013939 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013942 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013944 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013947 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013950 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013953 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013956 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013959 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013961 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013964 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013968 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013971 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013974 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013976 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013979 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013982 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013985 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013987 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013990 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 02:58:03.018938 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013993 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013996 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.013999 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014003 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014007 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014010 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014013 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014016 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014019 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014022 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014024 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014027 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014032 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014036 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014039 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014042 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014045 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014048 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014051 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 02:58:03.019450 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014055 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014057 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014060 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014063 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014067 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014070 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014074 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014077 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014080 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014083 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014086 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014089 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014092 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014094 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 02:58:03.019968 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014097 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.014102 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014221 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014226 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014229 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014233 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014235 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014239 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014242 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014244 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014247 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014250 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014253 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014256 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014259 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 18 02:58:03.020355 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014261 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014265 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014267 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014270 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014273 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014276 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014278 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014281 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014284 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014286 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014289 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014292 2575 feature_gate.go:328] unrecognized feature gate: Example Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014295 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014297 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014300 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014303 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014306 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014308 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014312 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014315 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 18 02:58:03.020790 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014318 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014321 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014324 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014326 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014329 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014332 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014335 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014338 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014340 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014343 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014347 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014350 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014353 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014355 2575 feature_gate.go:328] unrecognized feature gate: Example2 Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014358 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014361 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014363 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014366 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014369 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014371 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 18 02:58:03.021308 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014374 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014377 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014380 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014384 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014388 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014391 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014395 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014397 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014400 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014403 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014406 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014409 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014412 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014414 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014417 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014420 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014423 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014425 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014428 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 18 02:58:03.021933 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014431 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014435 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014438 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014441 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014445 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014448 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014451 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014454 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014457 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014459 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014462 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014465 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014468 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014470 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014473 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014477 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014480 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014498 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014503 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014506 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 18 02:58:03.022532 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014509 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014512 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014515 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014518 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014521 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014524 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:03.014528 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.014534 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.014631 2575 server.go:962] "Client rotation is on, will bootstrap in background" Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.016687 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.017856 2575 server.go:1019] "Starting client certificate rotation" Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.017961 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.018545 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 18 02:58:03.023155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.020676 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 02:58:03.023594 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.021797 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 18 02:58:03.025460 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.025442 2575 log.go:25] "Validated CRI v1 runtime API" Sep 18 02:58:03.027313 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.027299 2575 log.go:25] "Validated CRI v1 image API" Sep 18 02:58:03.028812 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.028798 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 18 02:58:03.032765 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.032747 2575 fs.go:135] Filesystem UUIDs: map[13a33f90-2c1b-40e5-96ab-4da29e21ad65:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f8e48541-af04-4846-b3d4-29a37c718221:/dev/nvme0n1p3] Sep 18 02:58:03.032823 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.032764 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 18 02:58:03.039107 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.038982 2575 manager.go:216] Machine: {Timestamp:2026-09-18 02:58:03.038439712 +0000 UTC m=+2.080763115 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098517 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2182de0415d57b8e900f92856d701a SystemUUID:ec2182de-0415-d57b-8e90-0f92856d701a BootID:6e097cfb-bd93-4179-b7ea-93b67a4f665a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c9:75:55:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c9:75:55:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:77:c7:75:ba:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 18 02:58:03.039107 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.039098 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 18 02:58:03.039241 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.039171 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 18 02:58:03.041086 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.041057 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 18 02:58:03.041262 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.041089 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 18 02:58:03.042503 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.042475 2575 topology_manager.go:138] "Creating topology manager with none policy" Sep 18 02:58:03.042620 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.042508 2575 container_manager_linux.go:309] "Creating device plugin manager" Sep 18 02:58:03.042620 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.042519 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 02:58:03.042620 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.042535 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 18 02:58:03.042773 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.042625 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 18 02:58:03.046831 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.046817 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 18 02:58:03.046974 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.046962 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 18 02:58:03.047033 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.047004 2575 kubelet.go:486] "Attempting to sync node with API server" Sep 18 02:58:03.047033 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.047019 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 18 02:58:03.047141 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.047035 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 18 02:58:03.047141 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.047050 2575 kubelet.go:398] "Adding apiserver pod source" Sep 18 02:58:03.047141 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.047063 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 18 02:58:03.055387 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.055359 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 02:58:03.055387 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.055390 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 18 02:58:03.057780 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.057762 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1" Sep 18 02:58:03.060025 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.060007 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 18 02:58:03.060103 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.060055 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 18 02:58:03.061095 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061082 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 18 02:58:03.061155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061102 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 18 02:58:03.061155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061109 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 18 02:58:03.061155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061114 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 18 02:58:03.061155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061125 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 18 02:58:03.061155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061133 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 18 02:58:03.061155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061154 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 18 02:58:03.061410 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061163 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 18 02:58:03.061410 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061173 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 18 02:58:03.061410 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061188 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 18 02:58:03.061410 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061202 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 18 02:58:03.061410 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061207 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 18 02:58:03.061410 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061230 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 18 02:58:03.061410 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061236 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 18 02:58:03.061410 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.061158 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 02:58:03.071503 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.071476 2575 server.go:1268] "Started kubelet" Sep 18 02:58:03.071604 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.071562 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 18 02:58:03.071663 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.071566 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 18 02:58:03.071663 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.071628 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 18 02:58:03.072253 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.072224 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 18 02:58:03.072357 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.072263 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-53.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 18 02:58:03.072357 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.072330 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 18 02:58:03.072507 ip-10-0-134-53 systemd[1]: Started Kubernetes Kubelet. Sep 18 02:58:03.072863 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.072831 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 18 02:58:03.073855 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.073835 2575 server.go:310] "Adding debug handlers to kubelet server" Sep 18 02:58:03.075779 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.075751 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 18 02:58:03.079122 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.079107 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 18 02:58:03.079203 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.079129 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 18 02:58:03.079269 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.079232 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.079684 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.079644 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 18 02:58:03.079910 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.079655 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 18 02:58:03.079967 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.079944 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 18 02:58:03.080064 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.080047 2575 reconstruct.go:97] "Volume reconstruction finished" Sep 18 02:58:03.080178 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.080166 2575 reconciler.go:29] "Reconciler: start to sync state" Sep 18 02:58:03.080711 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.080693 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 18 02:58:03.080711 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.080709 2575 factory.go:55] Registering systemd factory Sep 18 02:58:03.080711 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.080716 2575 factory.go:223] Registration of the systemd container factory successfully Sep 18 02:58:03.080969 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.080945 2575 factory.go:153] Registering CRI-O factory Sep 18 02:58:03.081006 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.080975 2575 factory.go:223] Registration of the crio container factory successfully Sep 18 02:58:03.081006 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.080993 2575 factory.go:103] Registering Raw factory Sep 18 02:58:03.081066 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.081007 2575 manager.go:1196] Started watching for new ooms in manager Sep 18 02:58:03.081497 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.081482 2575 manager.go:349] Starting recovery of all containers Sep 18 02:58:03.106162 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.106134 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nnpc5" Sep 18 02:58:03.106261 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.106174 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nnpc5" Sep 18 02:58:03.106261 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.106190 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 18 02:58:03.106529 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.106498 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 18 02:58:03.118475 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.118367 2575 manager.go:354] Recovery completed Sep 18 02:58:03.123061 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.123048 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 02:58:03.125256 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.125241 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 02:58:03.125318 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.125268 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 02:58:03.125318 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.125279 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 02:58:03.125849 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.125834 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 18 02:58:03.125849 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.125842 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 02:58:03.125849 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.125849 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 18 02:58:03.126025 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.125868 2575 state_mem.go:36] "Initialized new in-memory state store" Sep 18 02:58:03.126636 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.126620 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 02:58:03.126690 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.126648 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 02:58:03.126690 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.126659 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 02:58:03.128056 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.128045 2575 policy_none.go:49] "None policy: Start" Sep 18 02:58:03.128097 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.128061 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 18 02:58:03.128097 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.128072 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 18 02:58:03.130164 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.130153 2575 policy_none.go:47] "Start" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.170108 2575 manager.go:337] "Starting Device Plugin manager" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.170145 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.170154 2575 server.go:87] "Starting device plugin registration server" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.170346 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.170365 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.170481 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.170676 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.170686 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.171051 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 18 02:58:03.176148 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.171095 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.205887 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.205867 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 18 02:58:03.207203 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.207184 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 18 02:58:03.207299 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.207225 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 18 02:58:03.207299 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.207255 2575 kubelet.go:2448] "Starting kubelet main sync loop" Sep 18 02:58:03.207299 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.207292 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 18 02:58:03.210286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.210268 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 02:58:03.272122 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.272062 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 02:58:03.272915 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.272900 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 02:58:03.272984 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.272928 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 02:58:03.272984 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.272945 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 02:58:03.272984 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.272970 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.284257 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.284239 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.284310 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.284261 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-53.ec2.internal\": node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.307468 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.307446 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal"] Sep 18 02:58:03.307534 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.307508 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 02:58:03.307534 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.307516 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.308276 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.308260 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 02:58:03.308331 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.308296 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 02:58:03.308331 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.308308 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 02:58:03.311042 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311029 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 02:58:03.311184 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311168 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.311244 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311203 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 02:58:03.311797 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311776 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 02:58:03.311935 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311811 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 02:58:03.311935 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311778 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 02:58:03.311935 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311827 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 02:58:03.311935 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311854 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 02:58:03.311935 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.311873 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 02:58:03.314277 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.314260 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.314360 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.314299 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 18 02:58:03.315024 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.314997 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientMemory" Sep 18 02:58:03.315116 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.315027 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 18 02:58:03.315116 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.315042 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeHasSufficientPID" Sep 18 02:58:03.337158 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.337137 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-53.ec2.internal\" not found" node="ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.341899 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.341884 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-53.ec2.internal\" not found" node="ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.382148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.382122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88aa468796db440760593d0cd12d871c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal\" (UID: \"88aa468796db440760593d0cd12d871c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.382219 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.382164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88aa468796db440760593d0cd12d871c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal\" (UID: \"88aa468796db440760593d0cd12d871c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.382219 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.382201 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8161551427e43bab84dff04d6eaa689-config\") pod \"kube-apiserver-proxy-ip-10-0-134-53.ec2.internal\" (UID: \"e8161551427e43bab84dff04d6eaa689\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.407785 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.407750 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.483135 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.483113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88aa468796db440760593d0cd12d871c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal\" (UID: \"88aa468796db440760593d0cd12d871c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.483227 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.483136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88aa468796db440760593d0cd12d871c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal\" (UID: \"88aa468796db440760593d0cd12d871c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.483227 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.483154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8161551427e43bab84dff04d6eaa689-config\") pod \"kube-apiserver-proxy-ip-10-0-134-53.ec2.internal\" (UID: \"e8161551427e43bab84dff04d6eaa689\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.483227 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.483178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8161551427e43bab84dff04d6eaa689-config\") pod \"kube-apiserver-proxy-ip-10-0-134-53.ec2.internal\" (UID: \"e8161551427e43bab84dff04d6eaa689\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.483227 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.483217 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88aa468796db440760593d0cd12d871c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal\" (UID: \"88aa468796db440760593d0cd12d871c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.483368 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.483222 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88aa468796db440760593d0cd12d871c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal\" (UID: \"88aa468796db440760593d0cd12d871c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.508864 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.508830 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.610089 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.610067 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.640718 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.640696 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.646244 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:03.646064 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" Sep 18 02:58:03.711366 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.711342 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.812841 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.812812 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:03.914435 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:03.914371 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:04.015939 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:04.015911 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:04.017095 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.017081 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 18 02:58:04.017237 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.017218 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 18 02:58:04.113435 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.113391 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 02:53:03 +0000 UTC" deadline="2028-05-21 15:10:45.251796312 +0000 UTC" Sep 18 02:58:04.113435 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.113430 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14676h12m41.138369901s" Sep 18 02:58:04.116601 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:04.116580 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:04.177062 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.176999 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 02:58:04.216763 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:04.216736 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:04.289594 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.289572 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 02:58:04.317256 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:04.317231 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:04.417563 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:04.417537 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-53.ec2.internal\" not found" Sep 18 02:58:04.433477 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.433412 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 02:58:04.438815 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:04.438771 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8161551427e43bab84dff04d6eaa689.slice/crio-adfe77a8ac5cac6492648e5f111ed51b972606676411e378b0a71323bd69fcc6 WatchSource:0}: Error finding container adfe77a8ac5cac6492648e5f111ed51b972606676411e378b0a71323bd69fcc6: Status 404 returned error can't find the container with id adfe77a8ac5cac6492648e5f111ed51b972606676411e378b0a71323bd69fcc6 Sep 18 02:58:04.439254 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:04.439234 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88aa468796db440760593d0cd12d871c.slice/crio-78395d8f41655ad0011faefe00040d240dca00ae8bb9e86a92c45ec9d0668a3d WatchSource:0}: Error finding container 78395d8f41655ad0011faefe00040d240dca00ae8bb9e86a92c45ec9d0668a3d: Status 404 returned error can't find the container with id 78395d8f41655ad0011faefe00040d240dca00ae8bb9e86a92c45ec9d0668a3d Sep 18 02:58:04.444607 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.444590 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 02:58:04.479830 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.479804 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" Sep 18 02:58:04.497474 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.497452 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 02:58:04.498562 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.498549 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" Sep 18 02:58:04.514401 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:04.514382 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 18 02:58:05.049009 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.048981 2575 apiserver.go:52] "Watching apiserver" Sep 18 02:58:05.058200 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.058174 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 18 02:58:05.058791 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.058760 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx","openshift-cluster-node-tuning-operator/tuned-89xww","openshift-dns/node-resolver-qsvwf","openshift-image-registry/node-ca-579bg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal","openshift-multus/multus-lmfcw","kube-system/global-pull-secret-syncer-bd45r","openshift-multus/multus-additional-cni-plugins-qrbr8","openshift-multus/network-metrics-daemon-h2h9j","openshift-network-diagnostics/network-check-target-h6fj8","openshift-network-operator/iptables-alerter-d96hd","openshift-ovn-kubernetes/ovnkube-node-nvdqj","kube-system/konnectivity-agent-khsq5"] Sep 18 02:58:05.061575 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.061521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.064784 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.064762 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.067214 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.067192 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.069721 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.069697 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.072847 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.073655 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.074154 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.074382 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.074745 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.074774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pb987\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.074983 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.075015 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.075169 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.075758 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.075827 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.076002 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.076009 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 18 02:58:05.076286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.075758 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m95fg\"" Sep 18 02:58:05.080751 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.077378 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 18 02:58:05.080751 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.077590 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hj86n\"" Sep 18 02:58:05.080751 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.077764 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 18 02:58:05.080751 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.079284 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 18 02:58:05.080751 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.079591 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 18 02:58:05.080751 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.080164 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 18 02:58:05.080751 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.080235 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.083696 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.082679 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 18 02:58:05.083696 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.082954 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 18 02:58:05.083696 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.083450 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 18 02:58:05.083696 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.083577 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2zx59\"" Sep 18 02:58:05.083964 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.083921 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 18 02:58:05.084331 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.084311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.084560 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.084542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 18 02:58:05.084646 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.084564 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:05.085437 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.085122 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n78dm\"" Sep 18 02:58:05.085437 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.085138 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 18 02:58:05.085437 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.085214 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8d6vt\"" Sep 18 02:58:05.085661 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.085590 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.085718 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.085686 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4bl4l\"" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-netns\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089543 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysconfig\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-cni-binary-copy\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-var-lib-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089647 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-cnibin\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089670 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-k8s-cni-cncf-io\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-slash\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-ovn\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089745 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovnkube-config\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b28acd24-e9d1-4daa-8f28-edefbacbda56-host\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ede2701f-9c64-4a2b-9679-ee282f6106e2-dbus\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-modprobe-d\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089863 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-var-lib-kubelet\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089887 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-cni-bin\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.091572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-conf-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-daemon-config\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-lib-modules\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.089981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-node-log\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090028 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcjrc\" (UniqueName: \"kubernetes.io/projected/e96cfa56-964e-4765-ae0c-ae2a0984fd92-kube-api-access-rcjrc\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysctl-conf\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-run\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-system-cni-dir\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-systemd\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfh9\" (UniqueName: \"kubernetes.io/projected/8f7b1f69-de0d-472c-b7be-22cb32331ca2-kube-api-access-dtfh9\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090188 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-etc-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-cni-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-system-cni-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ede2701f-9c64-4a2b-9679-ee282f6106e2-kubelet-config\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.092425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-cni-netd\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-env-overrides\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-kubernetes\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090384 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f7b1f69-de0d-472c-b7be-22cb32331ca2-hosts-file\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090444 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovnkube-script-lib\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysctl-d\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090516 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e18545b-68c4-4874-a83e-7f6db48b7a5c-tmp\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj5jx\" (UniqueName: \"kubernetes.io/projected/8e18545b-68c4-4874-a83e-7f6db48b7a5c-kube-api-access-mj5jx\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4-agent-certs\") pod \"konnectivity-agent-khsq5\" (UID: \"c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4\") " pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4-konnectivity-ca\") pod \"konnectivity-agent-khsq5\" (UID: \"c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4\") " pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-cnibin\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8e16660-8e08-42e2-a9ea-24a109e04883-cni-binary-copy\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-cni-multus\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090707 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-kubelet\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090737 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-multus-certs\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.093169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090834 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv4tq\" (UniqueName: \"kubernetes.io/projected/23215b09-4012-4a2d-b55c-465d0f47d190-kube-api-access-qv4tq\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090860 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-kubelet\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-log-socket\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b28acd24-e9d1-4daa-8f28-edefbacbda56-serviceca\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.090947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-socket-dir-parent\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-hostroot\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsc9t\" (UniqueName: \"kubernetes.io/projected/e8e16660-8e08-42e2-a9ea-24a109e04883-kube-api-access-nsc9t\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-cni-bin\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f7b1f69-de0d-472c-b7be-22cb32331ca2-tmp-dir\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091221 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-run-netns\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-systemd\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-host\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-tuned\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091411 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7psjx\" (UniqueName: \"kubernetes.io/projected/b28acd24-e9d1-4daa-8f28-edefbacbda56-kube-api-access-7psjx\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.093880 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-etc-kubernetes\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.094773 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.091476 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:05.094773 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091531 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-systemd-units\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.094773 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovn-node-metrics-cert\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.094773 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.091594 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-sys\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.094773 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.092674 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:05.094773 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.092760 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:05.095089 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.094969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.096549 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.096331 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 18 02:58:05.096931 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.096760 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 18 02:58:05.097291 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.097148 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 18 02:58:05.098429 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.097624 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hwngw\"" Sep 18 02:58:05.098429 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.098079 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 18 02:58:05.099157 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.099030 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ttx9l\"" Sep 18 02:58:05.099350 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.099324 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 18 02:58:05.099647 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.099580 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 18 02:58:05.100595 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.100477 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 18 02:58:05.113352 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.113329 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 18 02:58:05.137365 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.137340 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rs9qc" Sep 18 02:58:05.148911 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.148878 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rs9qc" Sep 18 02:58:05.180884 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.180863 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 18 02:58:05.189143 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.188964 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 18 02:58:05.192286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv4tq\" (UniqueName: \"kubernetes.io/projected/23215b09-4012-4a2d-b55c-465d0f47d190-kube-api-access-qv4tq\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.192399 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-kubelet\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.192399 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-log-socket\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.192399 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192382 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b28acd24-e9d1-4daa-8f28-edefbacbda56-serviceca\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.192599 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192410 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66104f45-4a8f-419d-b725-7f7ae769a5ed-host-slash\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.192599 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192416 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-kubelet\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.192599 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192455 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-socket-dir-parent\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.192599 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192481 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-hostroot\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.192599 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsc9t\" (UniqueName: \"kubernetes.io/projected/e8e16660-8e08-42e2-a9ea-24a109e04883-kube-api-access-nsc9t\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.192599 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-cni-bin\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f7b1f69-de0d-472c-b7be-22cb32331ca2-tmp-dir\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-run-netns\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-systemd\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192694 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-log-socket\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192698 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-host\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-tuned\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192765 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-host\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7psjx\" (UniqueName: \"kubernetes.io/projected/b28acd24-e9d1-4daa-8f28-edefbacbda56-kube-api-access-7psjx\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192809 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-etc-kubernetes\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-systemd-units\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192846 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-socket-dir-parent\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192862 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovn-node-metrics-cert\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192879 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b28acd24-e9d1-4daa-8f28-edefbacbda56-serviceca\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.192904 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-sys\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-netns\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysconfig\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.192984 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-cni-binary-copy\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193012 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-sys-fs\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4nv2\" (UniqueName: \"kubernetes.io/projected/9c1dbf28-b996-4381-99fb-a8eb3961e052-kube-api-access-k4nv2\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193124 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-var-lib-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193158 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-cnibin\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193164 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193172 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-systemd-units\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-k8s-cni-cncf-io\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193221 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-slash\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193228 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-netns\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-ovn\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-hostroot\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.193645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193288 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-run-ovn-kubernetes\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193382 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-etc-kubernetes\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193431 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysconfig\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193712 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f7b1f69-de0d-472c-b7be-22cb32331ca2-tmp-dir\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193762 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-run-netns\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.193808 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-systemd\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194050 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-cni-binary-copy\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194108 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-sys\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-cni-bin\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194183 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-var-lib-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194228 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-k8s-cni-cncf-io\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194272 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-cnibin\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194315 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-slash\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194341 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-ovn\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovnkube-config\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b28acd24-e9d1-4daa-8f28-edefbacbda56-host\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.194548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ede2701f-9c64-4a2b-9679-ee282f6106e2-dbus\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194479 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-modprobe-d\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-var-lib-kubelet\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-cni-bin\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-conf-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194627 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-daemon-config\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194653 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-lib-modules\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-registration-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-node-log\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcjrc\" (UniqueName: \"kubernetes.io/projected/e96cfa56-964e-4765-ae0c-ae2a0984fd92-kube-api-access-rcjrc\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysctl-conf\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovnkube-config\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-run\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-system-cni-dir\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.195446 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.194976 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-device-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195004 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrx85\" (UniqueName: \"kubernetes.io/projected/66104f45-4a8f-419d-b725-7f7ae769a5ed-kube-api-access-jrx85\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-systemd\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfh9\" (UniqueName: \"kubernetes.io/projected/8f7b1f69-de0d-472c-b7be-22cb32331ca2-kube-api-access-dtfh9\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqtfv\" (UniqueName: \"kubernetes.io/projected/f815a6e0-6f48-49c4-8e9c-257843eb3eed-kube-api-access-vqtfv\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-etc-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-cni-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-system-cni-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195302 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-socket-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195331 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-etc-selinux\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ede2701f-9c64-4a2b-9679-ee282f6106e2-kubelet-config\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-cni-netd\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195400 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-daemon-config\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-env-overrides\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-kubernetes\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195453 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-cni-bin\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.196395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f7b1f69-de0d-472c-b7be-22cb32331ca2-hosts-file\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66104f45-4a8f-419d-b725-7f7ae769a5ed-iptables-alerter-script\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovnkube-script-lib\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysctl-d\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195615 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ede2701f-9c64-4a2b-9679-ee282f6106e2-dbus\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e18545b-68c4-4874-a83e-7f6db48b7a5c-tmp\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195659 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b28acd24-e9d1-4daa-8f28-edefbacbda56-host\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj5jx\" (UniqueName: \"kubernetes.io/projected/8e18545b-68c4-4874-a83e-7f6db48b7a5c-kube-api-access-mj5jx\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195726 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-modprobe-d\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195780 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-var-lib-kubelet\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195782 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ede2701f-9c64-4a2b-9679-ee282f6106e2-kubelet-config\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195819 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-cni-netd\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195824 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-conf-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4-agent-certs\") pod \"konnectivity-agent-khsq5\" (UID: \"c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4\") " pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4-konnectivity-ca\") pod \"konnectivity-agent-khsq5\" (UID: \"c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4\") " pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-cnibin\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8e16660-8e08-42e2-a9ea-24a109e04883-cni-binary-copy\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.195982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-cni-multus\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196013 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-kubelet\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-multus-certs\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196073 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196198 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-env-overrides\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-kubernetes\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196321 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f7b1f69-de0d-472c-b7be-22cb32331ca2-hosts-file\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.196808 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23215b09-4012-4a2d-b55c-465d0f47d190-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197004 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-lib-modules\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197084 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovn-node-metrics-cert\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.197088 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-node-log\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.197162 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret podName:ede2701f-9c64-4a2b-9679-ee282f6106e2 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:05.697145424 +0000 UTC m=+4.739468817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret") pod "global-pull-secret-syncer-bd45r" (UID: "ede2701f-9c64-4a2b-9679-ee282f6106e2") : object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-system-cni-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.198224 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197331 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e96cfa56-964e-4765-ae0c-ae2a0984fd92-ovnkube-script-lib\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197366 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysctl-conf\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197421 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-sysctl-d\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197468 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-systemd\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197505 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e18545b-68c4-4874-a83e-7f6db48b7a5c-run\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197537 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-system-cni-dir\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-etc-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197576 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23215b09-4012-4a2d-b55c-465d0f47d190-cnibin\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197615 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-multus-cni-dir\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-run-multus-certs\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197637 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-run-openvswitch\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-kubelet\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197670 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8e16660-8e08-42e2-a9ea-24a109e04883-host-var-lib-cni-multus\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197822 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8e16660-8e08-42e2-a9ea-24a109e04883-cni-binary-copy\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4-konnectivity-ca\") pod \"konnectivity-agent-khsq5\" (UID: \"c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4\") " pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.197582 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e96cfa56-964e-4765-ae0c-ae2a0984fd92-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.199170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.198204 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8e18545b-68c4-4874-a83e-7f6db48b7a5c-etc-tuned\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.200794 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.200286 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e18545b-68c4-4874-a83e-7f6db48b7a5c-tmp\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.200794 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.200741 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4-agent-certs\") pod \"konnectivity-agent-khsq5\" (UID: \"c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4\") " pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:05.215692 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.215615 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" event={"ID":"e8161551427e43bab84dff04d6eaa689","Type":"ContainerStarted","Data":"adfe77a8ac5cac6492648e5f111ed51b972606676411e378b0a71323bd69fcc6"} Sep 18 02:58:05.217548 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.217525 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7psjx\" (UniqueName: \"kubernetes.io/projected/b28acd24-e9d1-4daa-8f28-edefbacbda56-kube-api-access-7psjx\") pod \"node-ca-579bg\" (UID: \"b28acd24-e9d1-4daa-8f28-edefbacbda56\") " pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.218529 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.218477 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" event={"ID":"88aa468796db440760593d0cd12d871c","Type":"ContainerStarted","Data":"78395d8f41655ad0011faefe00040d240dca00ae8bb9e86a92c45ec9d0668a3d"} Sep 18 02:58:05.220170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.220143 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv4tq\" (UniqueName: \"kubernetes.io/projected/23215b09-4012-4a2d-b55c-465d0f47d190-kube-api-access-qv4tq\") pod \"multus-additional-cni-plugins-qrbr8\" (UID: \"23215b09-4012-4a2d-b55c-465d0f47d190\") " pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.222784 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.222764 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsc9t\" (UniqueName: \"kubernetes.io/projected/e8e16660-8e08-42e2-a9ea-24a109e04883-kube-api-access-nsc9t\") pod \"multus-lmfcw\" (UID: \"e8e16660-8e08-42e2-a9ea-24a109e04883\") " pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.231162 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.231135 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfh9\" (UniqueName: \"kubernetes.io/projected/8f7b1f69-de0d-472c-b7be-22cb32331ca2-kube-api-access-dtfh9\") pod \"node-resolver-qsvwf\" (UID: \"8f7b1f69-de0d-472c-b7be-22cb32331ca2\") " pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.233066 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.233043 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcjrc\" (UniqueName: \"kubernetes.io/projected/e96cfa56-964e-4765-ae0c-ae2a0984fd92-kube-api-access-rcjrc\") pod \"ovnkube-node-nvdqj\" (UID: \"e96cfa56-964e-4765-ae0c-ae2a0984fd92\") " pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.234002 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.233977 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj5jx\" (UniqueName: \"kubernetes.io/projected/8e18545b-68c4-4874-a83e-7f6db48b7a5c-kube-api-access-mj5jx\") pod \"tuned-89xww\" (UID: \"8e18545b-68c4-4874-a83e-7f6db48b7a5c\") " pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.297044 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-device-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297210 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrx85\" (UniqueName: \"kubernetes.io/projected/66104f45-4a8f-419d-b725-7f7ae769a5ed-kube-api-access-jrx85\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.297210 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqtfv\" (UniqueName: \"kubernetes.io/projected/f815a6e0-6f48-49c4-8e9c-257843eb3eed-kube-api-access-vqtfv\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:05.297210 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297145 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-socket-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297210 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-etc-selinux\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297210 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66104f45-4a8f-419d-b725-7f7ae769a5ed-iptables-alerter-script\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66104f45-4a8f-419d-b725-7f7ae769a5ed-host-slash\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297281 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-socket-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297156 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-device-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297362 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297391 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-sys-fs\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297404 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-etc-selinux\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4nv2\" (UniqueName: \"kubernetes.io/projected/9c1dbf28-b996-4381-99fb-a8eb3961e052-kube-api-access-k4nv2\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/66104f45-4a8f-419d-b725-7f7ae769a5ed-host-slash\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297470 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-sys-fs\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297510 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-registration-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.297628 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:05.297670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297654 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c1dbf28-b996-4381-99fb-a8eb3961e052-registration-dir\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.298531 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.297685 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs podName:f815a6e0-6f48-49c4-8e9c-257843eb3eed nodeName:}" failed. No retries permitted until 2026-09-18 02:58:05.79766259 +0000 UTC m=+4.839985993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs") pod "network-metrics-daemon-h2h9j" (UID: "f815a6e0-6f48-49c4-8e9c-257843eb3eed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:05.298531 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.297882 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/66104f45-4a8f-419d-b725-7f7ae769a5ed-iptables-alerter-script\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.316591 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.316568 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 02:58:05.316705 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.316596 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 02:58:05.316705 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.316610 2575 projected.go:196] Error preparing data for projected volume kube-api-access-tjp9q for pod openshift-network-diagnostics/network-check-target-h6fj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:05.316705 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.316662 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q podName:efee14b0-15f3-4020-966b-2bb413ea6e4d nodeName:}" failed. No retries permitted until 2026-09-18 02:58:05.816643689 +0000 UTC m=+4.858967077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tjp9q" (UniqueName: "kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q") pod "network-check-target-h6fj8" (UID: "efee14b0-15f3-4020-966b-2bb413ea6e4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:05.320948 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.320903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqtfv\" (UniqueName: \"kubernetes.io/projected/f815a6e0-6f48-49c4-8e9c-257843eb3eed-kube-api-access-vqtfv\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:05.321106 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.321085 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4nv2\" (UniqueName: \"kubernetes.io/projected/9c1dbf28-b996-4381-99fb-a8eb3961e052-kube-api-access-k4nv2\") pod \"aws-ebs-csi-driver-node-mntwx\" (UID: \"9c1dbf28-b996-4381-99fb-a8eb3961e052\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.322586 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.322544 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrx85\" (UniqueName: \"kubernetes.io/projected/66104f45-4a8f-419d-b725-7f7ae769a5ed-kube-api-access-jrx85\") pod \"iptables-alerter-d96hd\" (UID: \"66104f45-4a8f-419d-b725-7f7ae769a5ed\") " pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.384638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.384593 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lmfcw" Sep 18 02:58:05.393764 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.393741 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:05.395793 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:05.395769 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e16660_8e08_42e2_a9ea_24a109e04883.slice/crio-dd1e422a64b6d0d6dd4a5c63ef5a437077d1f910ae094d44e0086cd7124a940a WatchSource:0}: Error finding container dd1e422a64b6d0d6dd4a5c63ef5a437077d1f910ae094d44e0086cd7124a940a: Status 404 returned error can't find the container with id dd1e422a64b6d0d6dd4a5c63ef5a437077d1f910ae094d44e0086cd7124a940a Sep 18 02:58:05.405093 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.405071 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89xww" Sep 18 02:58:05.406135 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:05.406102 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96cfa56_964e_4765_ae0c_ae2a0984fd92.slice/crio-b431aa8d6b090cd6995667e7c3776a55506000f41fc007e1a68df727c3d86482 WatchSource:0}: Error finding container b431aa8d6b090cd6995667e7c3776a55506000f41fc007e1a68df727c3d86482: Status 404 returned error can't find the container with id b431aa8d6b090cd6995667e7c3776a55506000f41fc007e1a68df727c3d86482 Sep 18 02:58:05.412402 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.412381 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qsvwf" Sep 18 02:58:05.415245 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:05.415220 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e18545b_68c4_4874_a83e_7f6db48b7a5c.slice/crio-450b133405b9bd361067d9630e6b92b34361c82caf25b12aa179a3c25d340bae WatchSource:0}: Error finding container 450b133405b9bd361067d9630e6b92b34361c82caf25b12aa179a3c25d340bae: Status 404 returned error can't find the container with id 450b133405b9bd361067d9630e6b92b34361c82caf25b12aa179a3c25d340bae Sep 18 02:58:05.421035 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.420984 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-579bg" Sep 18 02:58:05.423520 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:05.423479 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7b1f69_de0d_472c_b7be_22cb32331ca2.slice/crio-da8576f4607a0310134d953502eba0fd21cd9d0fb4e2d41b352e57356ffce875 WatchSource:0}: Error finding container da8576f4607a0310134d953502eba0fd21cd9d0fb4e2d41b352e57356ffce875: Status 404 returned error can't find the container with id da8576f4607a0310134d953502eba0fd21cd9d0fb4e2d41b352e57356ffce875 Sep 18 02:58:05.431392 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.431371 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:05.441568 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.441547 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" Sep 18 02:58:05.448792 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.448772 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" Sep 18 02:58:05.458312 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.458288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d96hd" Sep 18 02:58:05.699868 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.699783 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:05.700016 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.699932 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:05.700016 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.700005 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret podName:ede2701f-9c64-4a2b-9679-ee282f6106e2 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:06.699987095 +0000 UTC m=+5.742310501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret") pod "global-pull-secret-syncer-bd45r" (UID: "ede2701f-9c64-4a2b-9679-ee282f6106e2") : object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:05.800691 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.800662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:05.800842 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.800813 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:05.800882 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.800872 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs podName:f815a6e0-6f48-49c4-8e9c-257843eb3eed nodeName:}" failed. No retries permitted until 2026-09-18 02:58:06.800858132 +0000 UTC m=+5.843181518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs") pod "network-metrics-daemon-h2h9j" (UID: "f815a6e0-6f48-49c4-8e9c-257843eb3eed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:05.901209 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:05.901174 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:05.901377 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.901356 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 02:58:05.901464 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.901381 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 02:58:05.901464 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.901395 2575 projected.go:196] Error preparing data for projected volume kube-api-access-tjp9q for pod openshift-network-diagnostics/network-check-target-h6fj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:05.901558 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:05.901465 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q podName:efee14b0-15f3-4020-966b-2bb413ea6e4d nodeName:}" failed. No retries permitted until 2026-09-18 02:58:06.90144741 +0000 UTC m=+5.943770807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjp9q" (UniqueName: "kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q") pod "network-check-target-h6fj8" (UID: "efee14b0-15f3-4020-966b-2bb413ea6e4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:06.152562 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.152526 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 02:53:05 +0000 UTC" deadline="2028-03-21 14:49:52.737286164 +0000 UTC" Sep 18 02:58:06.152562 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.152555 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13211h51m46.584736104s" Sep 18 02:58:06.208252 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.208225 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:06.208386 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.208333 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:06.208451 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.208383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:06.208522 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.208501 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:06.221800 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.221770 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qsvwf" event={"ID":"8f7b1f69-de0d-472c-b7be-22cb32331ca2","Type":"ContainerStarted","Data":"da8576f4607a0310134d953502eba0fd21cd9d0fb4e2d41b352e57356ffce875"} Sep 18 02:58:06.223129 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.223101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89xww" event={"ID":"8e18545b-68c4-4874-a83e-7f6db48b7a5c","Type":"ContainerStarted","Data":"450b133405b9bd361067d9630e6b92b34361c82caf25b12aa179a3c25d340bae"} Sep 18 02:58:06.225943 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.225919 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"b431aa8d6b090cd6995667e7c3776a55506000f41fc007e1a68df727c3d86482"} Sep 18 02:58:06.227265 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.227238 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lmfcw" event={"ID":"e8e16660-8e08-42e2-a9ea-24a109e04883","Type":"ContainerStarted","Data":"dd1e422a64b6d0d6dd4a5c63ef5a437077d1f910ae094d44e0086cd7124a940a"} Sep 18 02:58:06.633471 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:06.633434 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28acd24_e9d1_4daa_8f28_edefbacbda56.slice/crio-ea57427b48d5863cfc991d1c72148a5f096583d6a4da13b117b9b430c9ef73ac WatchSource:0}: Error finding container ea57427b48d5863cfc991d1c72148a5f096583d6a4da13b117b9b430c9ef73ac: Status 404 returned error can't find the container with id ea57427b48d5863cfc991d1c72148a5f096583d6a4da13b117b9b430c9ef73ac Sep 18 02:58:06.679560 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:06.679535 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66104f45_4a8f_419d_b725_7f7ae769a5ed.slice/crio-c98b0e6592fbc57cbdf22f6d3102e694ea012dcbd32c568d2ebd710aba2af01a WatchSource:0}: Error finding container c98b0e6592fbc57cbdf22f6d3102e694ea012dcbd32c568d2ebd710aba2af01a: Status 404 returned error can't find the container with id c98b0e6592fbc57cbdf22f6d3102e694ea012dcbd32c568d2ebd710aba2af01a Sep 18 02:58:06.685724 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:06.685699 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8dac35d_7edf_4994_b7a9_2e54e4e7f7a4.slice/crio-cb6c1d8012e5ae32c1a6d0d6c304770578e0c4991c0a53bd13ec77f9cdffb5bc WatchSource:0}: Error finding container cb6c1d8012e5ae32c1a6d0d6c304770578e0c4991c0a53bd13ec77f9cdffb5bc: Status 404 returned error can't find the container with id cb6c1d8012e5ae32c1a6d0d6c304770578e0c4991c0a53bd13ec77f9cdffb5bc Sep 18 02:58:06.686471 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:06.686447 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1dbf28_b996_4381_99fb_a8eb3961e052.slice/crio-3d8997525f671f525d82383da9e0c3b93d5c9401c91b3ddd9ab39c4f7b3df4ce WatchSource:0}: Error finding container 3d8997525f671f525d82383da9e0c3b93d5c9401c91b3ddd9ab39c4f7b3df4ce: Status 404 returned error can't find the container with id 3d8997525f671f525d82383da9e0c3b93d5c9401c91b3ddd9ab39c4f7b3df4ce Sep 18 02:58:06.708530 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.708504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:06.708637 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.708622 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:06.708694 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.708685 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret podName:ede2701f-9c64-4a2b-9679-ee282f6106e2 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:08.708668044 +0000 UTC m=+7.750991444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret") pod "global-pull-secret-syncer-bd45r" (UID: "ede2701f-9c64-4a2b-9679-ee282f6106e2") : object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:06.810939 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.809709 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:06.810939 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.809973 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:06.810939 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.810014 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs podName:f815a6e0-6f48-49c4-8e9c-257843eb3eed nodeName:}" failed. No retries permitted until 2026-09-18 02:58:08.810001469 +0000 UTC m=+7.852324855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs") pod "network-metrics-daemon-h2h9j" (UID: "f815a6e0-6f48-49c4-8e9c-257843eb3eed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:06.910568 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:06.910467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:06.910733 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.910665 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 02:58:06.910733 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.910684 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 02:58:06.910733 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.910696 2575 projected.go:196] Error preparing data for projected volume kube-api-access-tjp9q for pod openshift-network-diagnostics/network-check-target-h6fj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:06.910889 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:06.910750 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q podName:efee14b0-15f3-4020-966b-2bb413ea6e4d nodeName:}" failed. No retries permitted until 2026-09-18 02:58:08.910732088 +0000 UTC m=+7.953055482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjp9q" (UniqueName: "kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q") pod "network-check-target-h6fj8" (UID: "efee14b0-15f3-4020-966b-2bb413ea6e4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:07.153634 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.153566 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 02:53:05 +0000 UTC" deadline="2028-06-23 22:33:42.809786038 +0000 UTC" Sep 18 02:58:07.153634 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.153633 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15475h35m35.656156659s" Sep 18 02:58:07.207593 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.207569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:07.207711 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:07.207689 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:07.253364 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.253330 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" event={"ID":"9c1dbf28-b996-4381-99fb-a8eb3961e052","Type":"ContainerStarted","Data":"3d8997525f671f525d82383da9e0c3b93d5c9401c91b3ddd9ab39c4f7b3df4ce"} Sep 18 02:58:07.255987 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.255961 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-khsq5" event={"ID":"c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4","Type":"ContainerStarted","Data":"cb6c1d8012e5ae32c1a6d0d6c304770578e0c4991c0a53bd13ec77f9cdffb5bc"} Sep 18 02:58:07.260313 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.260289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d96hd" event={"ID":"66104f45-4a8f-419d-b725-7f7ae769a5ed","Type":"ContainerStarted","Data":"c98b0e6592fbc57cbdf22f6d3102e694ea012dcbd32c568d2ebd710aba2af01a"} Sep 18 02:58:07.264212 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.264189 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" event={"ID":"e8161551427e43bab84dff04d6eaa689","Type":"ContainerStarted","Data":"e937d5d9024f7ab01dfdadc4544a00d9a5d10a0d00b38ca7b5da10e09862e3df"} Sep 18 02:58:07.272791 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.272767 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" event={"ID":"23215b09-4012-4a2d-b55c-465d0f47d190","Type":"ContainerStarted","Data":"cb6328e5d7eeb36ce741034413b267cfa88976b3bff9ea1d9a92e767ff2a84d9"} Sep 18 02:58:07.276362 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:07.276336 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-579bg" event={"ID":"b28acd24-e9d1-4daa-8f28-edefbacbda56","Type":"ContainerStarted","Data":"ea57427b48d5863cfc991d1c72148a5f096583d6a4da13b117b9b430c9ef73ac"} Sep 18 02:58:08.207893 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:08.207861 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:08.208346 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.207991 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:08.208346 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:08.208074 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:08.208346 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.208157 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:08.304876 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:08.304839 2575 generic.go:356] "Generic (PLEG): container finished" podID="88aa468796db440760593d0cd12d871c" containerID="891ea155e5f61637f0b9ae80c3fd6dad73042d8477204918d9306ac7c210bf9a" exitCode=0 Sep 18 02:58:08.305047 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:08.304923 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" event={"ID":"88aa468796db440760593d0cd12d871c","Type":"ContainerDied","Data":"891ea155e5f61637f0b9ae80c3fd6dad73042d8477204918d9306ac7c210bf9a"} Sep 18 02:58:08.329822 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:08.329745 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-53.ec2.internal" podStartSLOduration=4.329724466 podStartE2EDuration="4.329724466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:07.295618121 +0000 UTC m=+6.337941530" watchObservedRunningTime="2026-09-18 02:58:08.329724466 +0000 UTC m=+7.372047878" Sep 18 02:58:08.731286 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:08.731088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:08.731286 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.731244 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:08.731541 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.731300 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret podName:ede2701f-9c64-4a2b-9679-ee282f6106e2 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:12.73128385 +0000 UTC m=+11.773607244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret") pod "global-pull-secret-syncer-bd45r" (UID: "ede2701f-9c64-4a2b-9679-ee282f6106e2") : object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:08.831866 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:08.831825 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:08.832022 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.831976 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:08.832092 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.832035 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs podName:f815a6e0-6f48-49c4-8e9c-257843eb3eed nodeName:}" failed. No retries permitted until 2026-09-18 02:58:12.832017859 +0000 UTC m=+11.874341259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs") pod "network-metrics-daemon-h2h9j" (UID: "f815a6e0-6f48-49c4-8e9c-257843eb3eed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:08.932968 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:08.932933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:08.933161 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.933144 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 02:58:08.933243 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.933169 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 02:58:08.933243 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.933182 2575 projected.go:196] Error preparing data for projected volume kube-api-access-tjp9q for pod openshift-network-diagnostics/network-check-target-h6fj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:08.933243 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:08.933238 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q podName:efee14b0-15f3-4020-966b-2bb413ea6e4d nodeName:}" failed. No retries permitted until 2026-09-18 02:58:12.93322034 +0000 UTC m=+11.975543732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjp9q" (UniqueName: "kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q") pod "network-check-target-h6fj8" (UID: "efee14b0-15f3-4020-966b-2bb413ea6e4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:09.210209 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:09.210177 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:09.210686 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:09.210311 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:10.208292 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:10.208243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:10.208477 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:10.208389 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:10.208560 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:10.208473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:10.208620 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:10.208586 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:11.207860 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:11.207829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:11.208234 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:11.207923 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:12.208070 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:12.207979 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:12.208070 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:12.208015 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:12.208610 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.208105 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:12.208610 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.208317 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:12.766169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:12.766129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:12.766354 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.766303 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:12.766471 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.766375 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret podName:ede2701f-9c64-4a2b-9679-ee282f6106e2 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:20.766356838 +0000 UTC m=+19.808680237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret") pod "global-pull-secret-syncer-bd45r" (UID: "ede2701f-9c64-4a2b-9679-ee282f6106e2") : object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:12.867015 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:12.866915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:12.867181 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.867093 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:12.867181 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.867159 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs podName:f815a6e0-6f48-49c4-8e9c-257843eb3eed nodeName:}" failed. No retries permitted until 2026-09-18 02:58:20.867140929 +0000 UTC m=+19.909464332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs") pod "network-metrics-daemon-h2h9j" (UID: "f815a6e0-6f48-49c4-8e9c-257843eb3eed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:12.967750 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:12.967717 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:12.967925 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.967898 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 02:58:12.967925 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.967920 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 02:58:12.968032 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.967932 2575 projected.go:196] Error preparing data for projected volume kube-api-access-tjp9q for pod openshift-network-diagnostics/network-check-target-h6fj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:12.968032 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:12.967985 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q podName:efee14b0-15f3-4020-966b-2bb413ea6e4d nodeName:}" failed. No retries permitted until 2026-09-18 02:58:20.967968594 +0000 UTC m=+20.010291997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjp9q" (UniqueName: "kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q") pod "network-check-target-h6fj8" (UID: "efee14b0-15f3-4020-966b-2bb413ea6e4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:13.208890 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:13.208382 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:13.208890 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:13.208514 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:14.207577 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:14.207543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:14.207577 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:14.207566 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:14.207870 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:14.207675 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:14.207870 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:14.207722 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:15.208369 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:15.208339 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:15.208805 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:15.208475 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:16.207580 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:16.207492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:16.207580 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:16.207515 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:16.207783 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:16.207660 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:16.207836 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:16.207783 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:17.210731 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:17.210704 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:17.211222 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:17.210804 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:18.207635 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:18.207596 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:18.207816 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:18.207719 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:18.207816 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:18.207776 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:18.207930 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:18.207882 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:19.208169 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:19.208136 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:19.208508 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:19.208279 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:20.208277 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:20.208243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:20.208277 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:20.208275 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:20.208746 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:20.208370 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:20.208746 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:20.208489 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:20.823030 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:20.822991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:20.823210 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:20.823102 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:20.823210 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:20.823161 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret podName:ede2701f-9c64-4a2b-9679-ee282f6106e2 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:36.823142545 +0000 UTC m=+35.865465947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret") pod "global-pull-secret-syncer-bd45r" (UID: "ede2701f-9c64-4a2b-9679-ee282f6106e2") : object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:20.924300 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:20.924266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:20.924461 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:20.924432 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:20.924522 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:20.924503 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs podName:f815a6e0-6f48-49c4-8e9c-257843eb3eed nodeName:}" failed. No retries permitted until 2026-09-18 02:58:36.924482212 +0000 UTC m=+35.966805611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs") pod "network-metrics-daemon-h2h9j" (UID: "f815a6e0-6f48-49c4-8e9c-257843eb3eed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:21.025605 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:21.025571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:21.025775 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:21.025693 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 02:58:21.025775 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:21.025716 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 02:58:21.025775 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:21.025726 2575 projected.go:196] Error preparing data for projected volume kube-api-access-tjp9q for pod openshift-network-diagnostics/network-check-target-h6fj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:21.025775 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:21.025784 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q podName:efee14b0-15f3-4020-966b-2bb413ea6e4d nodeName:}" failed. No retries permitted until 2026-09-18 02:58:37.025766751 +0000 UTC m=+36.068090137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjp9q" (UniqueName: "kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q") pod "network-check-target-h6fj8" (UID: "efee14b0-15f3-4020-966b-2bb413ea6e4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:21.207782 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:21.207700 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:21.207931 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:21.207835 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:22.208240 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:22.208208 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:22.208712 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:22.208206 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:22.208712 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:22.208351 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:22.208712 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:22.208487 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:23.208205 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:23.208174 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:23.208353 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:23.208265 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:24.208715 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.208395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:24.208715 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.208400 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:24.209631 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:24.208759 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:24.209631 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:24.208838 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:24.342486 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.342243 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" event={"ID":"88aa468796db440760593d0cd12d871c","Type":"ContainerStarted","Data":"3846baa442c0083b71d319c4700b3f4d01cf51d839d6041277a90905ee62e6c8"} Sep 18 02:58:24.343980 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.343954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qsvwf" event={"ID":"8f7b1f69-de0d-472c-b7be-22cb32331ca2","Type":"ContainerStarted","Data":"b8f30d19237ea6275b2811040871356a1dd5f41675d1e4b525c788fa8464c281"} Sep 18 02:58:24.345677 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.345649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89xww" event={"ID":"8e18545b-68c4-4874-a83e-7f6db48b7a5c","Type":"ContainerStarted","Data":"b9f2fe655741f7caa090585a2e53b03fcc8cf25b239e7da952a082dc60592095"} Sep 18 02:58:24.349083 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.349061 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 02:58:24.349483 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.349456 2575 generic.go:356] "Generic (PLEG): container finished" podID="e96cfa56-964e-4765-ae0c-ae2a0984fd92" containerID="1fac7894b12b8406d460f176886a5278ac12ed8f26d7d88b2ae4fe96188dc364" exitCode=1 Sep 18 02:58:24.349575 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.349537 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"fa743befed3b4e700dad747b517f1c3bc541714b3f4f03f3c2eaa5aaaa988b8f"} Sep 18 02:58:24.349636 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.349614 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"40cbec97c20db5b6bcbfaa8540cf152f02beba783d1671f8a842ab54457d01b6"} Sep 18 02:58:24.349692 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.349669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"415dcba8f3e693cc0479be03ad528bfdf6fda3e53d0dc61b07d4029c1141d855"} Sep 18 02:58:24.349740 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.349732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"57ba6887c618592679dcf6669f317062d6e1d171b2bf58e5eb1e879731228745"} Sep 18 02:58:24.349788 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.349777 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerDied","Data":"1fac7894b12b8406d460f176886a5278ac12ed8f26d7d88b2ae4fe96188dc364"} Sep 18 02:58:24.349842 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.349829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"e04eee09dae4cf3949d39f205ca3ea37788247dbb9b1d613d6cdfb5d6197991a"} Sep 18 02:58:24.351480 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.351441 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lmfcw" event={"ID":"e8e16660-8e08-42e2-a9ea-24a109e04883","Type":"ContainerStarted","Data":"2d3ba4db2ae9164bcd7229a9c64a841a25fc2dd84c229d1ff7f0dc7e49644763"} Sep 18 02:58:24.353148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.353127 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" event={"ID":"9c1dbf28-b996-4381-99fb-a8eb3961e052","Type":"ContainerStarted","Data":"86c9f0331c015157aecf21f7fee64fe46d0df474f1de477a4921fd7c5dbfdcbe"} Sep 18 02:58:24.354890 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.354843 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-khsq5" event={"ID":"c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4","Type":"ContainerStarted","Data":"6665bc38eb5809c51d72afddc32596d3e5372fc3f49cd0f3f0c8b8a1510f9caf"} Sep 18 02:58:24.357182 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.357154 2575 generic.go:356] "Generic (PLEG): container finished" podID="23215b09-4012-4a2d-b55c-465d0f47d190" containerID="a7ac2def422783256c130ed784b33f48259e69a6e2b60c3e1f2a40956451433d" exitCode=0 Sep 18 02:58:24.357282 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.357235 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" event={"ID":"23215b09-4012-4a2d-b55c-465d0f47d190","Type":"ContainerDied","Data":"a7ac2def422783256c130ed784b33f48259e69a6e2b60c3e1f2a40956451433d"} Sep 18 02:58:24.360212 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.360176 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-579bg" event={"ID":"b28acd24-e9d1-4daa-8f28-edefbacbda56","Type":"ContainerStarted","Data":"ace40577989e596ee67c596f31dbde7a321c36b0f9dbc7a240546fa503311a71"} Sep 18 02:58:24.367898 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.367859 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-53.ec2.internal" podStartSLOduration=20.367849031 podStartE2EDuration="20.367849031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:24.367592527 +0000 UTC m=+23.409915937" watchObservedRunningTime="2026-09-18 02:58:24.367849031 +0000 UTC m=+23.410172438" Sep 18 02:58:24.427972 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.427932 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qsvwf" podStartSLOduration=7.690387099 podStartE2EDuration="21.427920212s" totalImagesPullingTime="13.737533113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:24.427845413 +0000 UTC m=+23.470168821" watchObservedRunningTime="2026-09-18 02:58:24.427920212 +0000 UTC m=+23.470243621" Sep 18 02:58:24.449828 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.449793 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lmfcw" podStartSLOduration=3.487581548 podStartE2EDuration="21.449784267s" totalImagesPullingTime="17.962202719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:24.449381706 +0000 UTC m=+23.491705114" watchObservedRunningTime="2026-09-18 02:58:24.449784267 +0000 UTC m=+23.492107672" Sep 18 02:58:24.479248 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.479189 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-89xww" podStartSLOduration=3.587271838 podStartE2EDuration="21.479178049s" totalImagesPullingTime="17.891906211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:24.47912702 +0000 UTC m=+23.521450439" watchObservedRunningTime="2026-09-18 02:58:24.479178049 +0000 UTC m=+23.521501457" Sep 18 02:58:24.499282 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.499247 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-579bg" podStartSLOduration=4.828896205 podStartE2EDuration="21.49923588s" totalImagesPullingTime="16.670339675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:24.499135348 +0000 UTC m=+23.541458756" watchObservedRunningTime="2026-09-18 02:58:24.49923588 +0000 UTC m=+23.541559279" Sep 18 02:58:24.745665 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:24.745640 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 18 02:58:25.181701 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:25.181545 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T02:58:24.745661921Z","UUID":"ed498eae-8fe6-4731-b1bf-158118e32b83","Handler":null,"Name":"","Endpoint":""} Sep 18 02:58:25.183267 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:25.183246 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 18 02:58:25.183267 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:25.183274 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 18 02:58:25.207552 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:25.207516 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:25.207672 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:25.207621 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:25.365228 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:25.365187 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" event={"ID":"9c1dbf28-b996-4381-99fb-a8eb3961e052","Type":"ContainerStarted","Data":"4386ce767f08c2c03f5c520b155dcbcc3a7481ce44cdfd6cd092e6decf512f1b"} Sep 18 02:58:25.367228 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:25.367198 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d96hd" event={"ID":"66104f45-4a8f-419d-b725-7f7ae769a5ed","Type":"ContainerStarted","Data":"8dd10506f45e71727f72406c57b17bcd56c569c87179f622c4e200cccb1bd0c0"} Sep 18 02:58:25.387630 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:25.387577 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-khsq5" podStartSLOduration=5.773045743 podStartE2EDuration="22.387561274s" totalImagesPullingTime="16.614515531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:24.520036822 +0000 UTC m=+23.562360231" watchObservedRunningTime="2026-09-18 02:58:25.387561274 +0000 UTC m=+24.429884685" Sep 18 02:58:26.208549 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:26.208518 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:26.208774 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:26.208533 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:26.208774 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:26.208661 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:26.208774 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:26.208711 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:26.372900 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:26.372619 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" event={"ID":"9c1dbf28-b996-4381-99fb-a8eb3961e052","Type":"ContainerStarted","Data":"efabfc026fb1238241f81314c4e0b23341119e1691bde29d3800017640c46740"} Sep 18 02:58:26.376747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:26.376723 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 02:58:26.377190 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:26.377162 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"11646e0181d4ca3a5fc9778e37e87335c0884bc6c0d411dbc3a1e30b917134ec"} Sep 18 02:58:26.404986 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:26.404938 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d96hd" podStartSLOduration=10.925593164 podStartE2EDuration="23.404922963s" totalImagesPullingTime="12.479329799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:25.387795304 +0000 UTC m=+24.430118725" watchObservedRunningTime="2026-09-18 02:58:26.404922963 +0000 UTC m=+25.447246371" Sep 18 02:58:27.208028 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:27.207995 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:27.208239 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:27.208120 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:28.207987 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:28.207952 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:28.207987 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:28.207991 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:28.208566 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:28.208081 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:28.208566 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:28.208237 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:28.311486 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:28.311450 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:28.312135 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:28.312110 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:28.329355 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:28.329302 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mntwx" podStartSLOduration=6.706459973 podStartE2EDuration="25.329283277s" totalImagesPullingTime="18.622823304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:26.405193905 +0000 UTC m=+25.447517314" watchObservedRunningTime="2026-09-18 02:58:28.329283277 +0000 UTC m=+27.371606686" Sep 18 02:58:29.208488 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:29.208293 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:29.209266 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:29.208551 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:29.386422 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:29.386382 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 02:58:29.386814 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:29.386790 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"a1004cb256c6c30a56fac6dfd8604b3f0a3ec2f9476ad0cf535837d09a4516fb"} Sep 18 02:58:29.387078 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:29.387056 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:29.387365 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:29.387341 2575 scope.go:117] "RemoveContainer" containerID="1fac7894b12b8406d460f176886a5278ac12ed8f26d7d88b2ae4fe96188dc364" Sep 18 02:58:29.388755 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:29.388708 2575 generic.go:356] "Generic (PLEG): container finished" podID="23215b09-4012-4a2d-b55c-465d0f47d190" containerID="7281eacb4e1ad7cafc269a66fe6f89f9d6bf90fe458e8c73768c22dda21d46ea" exitCode=0 Sep 18 02:58:29.388755 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:29.388744 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" event={"ID":"23215b09-4012-4a2d-b55c-465d0f47d190","Type":"ContainerDied","Data":"7281eacb4e1ad7cafc269a66fe6f89f9d6bf90fe458e8c73768c22dda21d46ea"} Sep 18 02:58:29.403670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:29.403650 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:30.052990 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.052967 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:30.053109 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.053095 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 18 02:58:30.053659 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.053637 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-khsq5" Sep 18 02:58:30.207711 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.207685 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:30.207865 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.207684 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:30.207865 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:30.207784 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:30.207865 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:30.207849 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:30.397362 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.397337 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 02:58:30.397778 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.397753 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" event={"ID":"e96cfa56-964e-4765-ae0c-ae2a0984fd92","Type":"ContainerStarted","Data":"5008c66c81d03afa80f0c234fe462cc051b4d22517943b4dcc588e03d2e8c9ed"} Sep 18 02:58:30.397889 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.397875 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:30.397951 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.397935 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:30.400205 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.400180 2575 generic.go:356] "Generic (PLEG): container finished" podID="23215b09-4012-4a2d-b55c-465d0f47d190" containerID="98ef4dc1f3607d8c0d4f189f6f25af69f11635d3c07b9789b7fd79601dda4581" exitCode=0 Sep 18 02:58:30.400327 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.400207 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" event={"ID":"23215b09-4012-4a2d-b55c-465d0f47d190","Type":"ContainerDied","Data":"98ef4dc1f3607d8c0d4f189f6f25af69f11635d3c07b9789b7fd79601dda4581"} Sep 18 02:58:30.412861 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.412843 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:58:30.434197 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.434158 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" podStartSLOduration=9.517569362 podStartE2EDuration="27.434146993s" totalImagesPullingTime="17.916577631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:30.432669589 +0000 UTC m=+29.474992999" watchObservedRunningTime="2026-09-18 02:58:30.434146993 +0000 UTC m=+29.476470401" Sep 18 02:58:30.523011 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.522987 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bd45r"] Sep 18 02:58:30.523107 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.523076 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:30.523167 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:30.523150 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:30.536449 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.536391 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h2h9j"] Sep 18 02:58:30.536523 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.536497 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:30.536608 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:30.536587 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:30.536977 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.536957 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h6fj8"] Sep 18 02:58:30.537183 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:30.537061 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:30.537183 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:30.537149 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:31.404576 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:31.404336 2575 generic.go:356] "Generic (PLEG): container finished" podID="23215b09-4012-4a2d-b55c-465d0f47d190" containerID="5a91f0d9420bdd0a3989bf77a6300113262d8e3fdaf2308d853086e7b5c0585c" exitCode=0 Sep 18 02:58:31.404932 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:31.404405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" event={"ID":"23215b09-4012-4a2d-b55c-465d0f47d190","Type":"ContainerDied","Data":"5a91f0d9420bdd0a3989bf77a6300113262d8e3fdaf2308d853086e7b5c0585c"} Sep 18 02:58:32.207582 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:32.207545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:32.207582 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:32.207571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:32.207800 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:32.207545 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:32.207800 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:32.207680 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:32.208264 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:32.208231 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:32.208475 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:32.208438 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:34.206508 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:34.206474 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:34.208578 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:34.208245 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:34.208578 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:34.208341 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:34.208578 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:34.208354 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:34.208578 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:34.208368 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:34.208578 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:34.208474 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:34.208578 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:34.208540 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:34.320230 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:34.320195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:34.421372 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:34.421272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:34.494120 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:34.494090 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:34.561321 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:34.561293 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:36.208340 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.208316 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:36.208780 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.208317 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:36.208780 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.208320 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:36.208780 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.208528 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h2h9j" podUID="f815a6e0-6f48-49c4-8e9c-257843eb3eed" Sep 18 02:58:36.208780 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.208567 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bd45r" podUID="ede2701f-9c64-4a2b-9679-ee282f6106e2" Sep 18 02:58:36.208780 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.208405 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h6fj8" podUID="efee14b0-15f3-4020-966b-2bb413ea6e4d" Sep 18 02:58:36.285913 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.285862 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-53.ec2.internal" event="NodeReady" Sep 18 02:58:36.285986 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.285945 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 18 02:58:36.347743 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.347674 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gpm7w"] Sep 18 02:58:36.350753 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.350735 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cm76t"] Sep 18 02:58:36.350878 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.350855 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gpm7w" Sep 18 02:58:36.353438 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.353421 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cc7555d-qw2r4"] Sep 18 02:58:36.353518 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.353443 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 18 02:58:36.353564 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.353532 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.353611 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.353572 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 18 02:58:36.353889 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.353871 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2lvvd\"" Sep 18 02:58:36.354042 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.354027 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 18 02:58:36.356139 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.356125 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.359175 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.359158 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 18 02:58:36.359255 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.359178 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 18 02:58:36.359303 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.359286 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jzrm7\"" Sep 18 02:58:36.362841 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.362821 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 18 02:58:36.363173 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.363154 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fwll5\"" Sep 18 02:58:36.363254 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.363158 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 18 02:58:36.363399 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.363386 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 18 02:58:36.368589 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.368573 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 18 02:58:36.375143 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.375121 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gpm7w"] Sep 18 02:58:36.375932 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.375916 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cc7555d-qw2r4"] Sep 18 02:58:36.376564 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.376545 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cm76t"] Sep 18 02:58:36.418278 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.418247 2575 generic.go:356] "Generic (PLEG): container finished" podID="23215b09-4012-4a2d-b55c-465d0f47d190" containerID="1dfc8021f30ac18b8e39a0fdad4452382361dcce8008b3ed423c3243116322c2" exitCode=0 Sep 18 02:58:36.418494 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.418282 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" event={"ID":"23215b09-4012-4a2d-b55c-465d0f47d190","Type":"ContainerDied","Data":"1dfc8021f30ac18b8e39a0fdad4452382361dcce8008b3ed423c3243116322c2"} Sep 18 02:58:36.436546 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436516 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-image-registry-private-configuration\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.436653 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.436653 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc6dz\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-kube-api-access-mc6dz\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.436653 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62njs\" (UniqueName: \"kubernetes.io/projected/1922ec46-41f0-481d-9c3a-3d400b2af38d-kube-api-access-62njs\") pod \"ingress-canary-gpm7w\" (UID: \"1922ec46-41f0-481d-9c3a-3d400b2af38d\") " pod="openshift-ingress-canary/ingress-canary-gpm7w" Sep 18 02:58:36.436809 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436667 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-registry-certificates\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.436809 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.436809 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1539f19e-0a38-4da7-857e-157ee37c2367-tmp-dir\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.436809 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l88cr\" (UniqueName: \"kubernetes.io/projected/1539f19e-0a38-4da7-857e-157ee37c2367-kube-api-access-l88cr\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.436982 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436814 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/898cb226-e34e-48e2-8353-53070accb576-ca-trust-extracted\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.436982 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-installation-pull-secrets\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.436982 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-bound-sa-token\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.436982 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1922ec46-41f0-481d-9c3a-3d400b2af38d-cert\") pod \"ingress-canary-gpm7w\" (UID: \"1922ec46-41f0-481d-9c3a-3d400b2af38d\") " pod="openshift-ingress-canary/ingress-canary-gpm7w" Sep 18 02:58:36.436982 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1539f19e-0a38-4da7-857e-157ee37c2367-config-volume\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.437167 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.436994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-trusted-ca\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538241 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/898cb226-e34e-48e2-8353-53070accb576-ca-trust-extracted\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538332 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-installation-pull-secrets\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538332 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538294 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-bound-sa-token\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538332 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1922ec46-41f0-481d-9c3a-3d400b2af38d-cert\") pod \"ingress-canary-gpm7w\" (UID: \"1922ec46-41f0-481d-9c3a-3d400b2af38d\") " pod="openshift-ingress-canary/ingress-canary-gpm7w" Sep 18 02:58:36.538501 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1539f19e-0a38-4da7-857e-157ee37c2367-config-volume\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.538501 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-trusted-ca\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538501 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-image-registry-private-configuration\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538501 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538501 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc6dz\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-kube-api-access-mc6dz\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62njs\" (UniqueName: \"kubernetes.io/projected/1922ec46-41f0-481d-9c3a-3d400b2af38d-kube-api-access-62njs\") pod \"ingress-canary-gpm7w\" (UID: \"1922ec46-41f0-481d-9c3a-3d400b2af38d\") " pod="openshift-ingress-canary/ingress-canary-gpm7w" Sep 18 02:58:36.538747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538598 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-registry-certificates\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.538747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1539f19e-0a38-4da7-857e-157ee37c2367-tmp-dir\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.538747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538654 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/898cb226-e34e-48e2-8353-53070accb576-ca-trust-extracted\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.538747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l88cr\" (UniqueName: \"kubernetes.io/projected/1539f19e-0a38-4da7-857e-157ee37c2367-kube-api-access-l88cr\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.539066 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.538897 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 02:58:36.539066 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.538912 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc7555d-qw2r4: secret "image-registry-tls" not found Sep 18 02:58:36.539066 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.538960 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 02:58:36.539066 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.538968 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls podName:898cb226-e34e-48e2-8353-53070accb576 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:37.038949813 +0000 UTC m=+36.081273215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls") pod "image-registry-7cc7555d-qw2r4" (UID: "898cb226-e34e-48e2-8353-53070accb576") : secret "image-registry-tls" not found Sep 18 02:58:36.539066 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.538965 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1539f19e-0a38-4da7-857e-157ee37c2367-config-volume\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.539066 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.538994 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls podName:1539f19e-0a38-4da7-857e-157ee37c2367 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:37.038982959 +0000 UTC m=+36.081306345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls") pod "dns-default-cm76t" (UID: "1539f19e-0a38-4da7-857e-157ee37c2367") : secret "dns-default-metrics-tls" not found Sep 18 02:58:36.539310 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.539220 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-registry-certificates\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.539354 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.539337 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1539f19e-0a38-4da7-857e-157ee37c2367-tmp-dir\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.539946 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.539925 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-trusted-ca\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.542167 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.542141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-image-registry-private-configuration\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.542283 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.542268 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-installation-pull-secrets\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.542332 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.542286 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1922ec46-41f0-481d-9c3a-3d400b2af38d-cert\") pod \"ingress-canary-gpm7w\" (UID: \"1922ec46-41f0-481d-9c3a-3d400b2af38d\") " pod="openshift-ingress-canary/ingress-canary-gpm7w" Sep 18 02:58:36.547301 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.547274 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-bound-sa-token\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.547660 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.547632 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62njs\" (UniqueName: \"kubernetes.io/projected/1922ec46-41f0-481d-9c3a-3d400b2af38d-kube-api-access-62njs\") pod \"ingress-canary-gpm7w\" (UID: \"1922ec46-41f0-481d-9c3a-3d400b2af38d\") " pod="openshift-ingress-canary/ingress-canary-gpm7w" Sep 18 02:58:36.547744 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.547729 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc6dz\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-kube-api-access-mc6dz\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:36.547926 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.547907 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l88cr\" (UniqueName: \"kubernetes.io/projected/1539f19e-0a38-4da7-857e-157ee37c2367-kube-api-access-l88cr\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:36.661985 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.661961 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gpm7w" Sep 18 02:58:36.840572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.840446 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:36.840690 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.840590 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:36.840690 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.840666 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret podName:ede2701f-9c64-4a2b-9679-ee282f6106e2 nodeName:}" failed. No retries permitted until 2026-09-18 02:59:08.840650675 +0000 UTC m=+67.882974061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret") pod "global-pull-secret-syncer-bd45r" (UID: "ede2701f-9c64-4a2b-9679-ee282f6106e2") : object "kube-system"/"original-pull-secret" not registered Sep 18 02:58:36.941234 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.941201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:36.941360 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.941339 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:36.941441 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:36.941430 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs podName:f815a6e0-6f48-49c4-8e9c-257843eb3eed nodeName:}" failed. No retries permitted until 2026-09-18 02:59:08.941390429 +0000 UTC m=+67.983713820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs") pod "network-metrics-daemon-h2h9j" (UID: "f815a6e0-6f48-49c4-8e9c-257843eb3eed") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 18 02:58:36.943048 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:36.943021 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gpm7w"] Sep 18 02:58:36.945877 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:36.945857 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1922ec46_41f0_481d_9c3a_3d400b2af38d.slice/crio-23e050a75aea13cf8cf3c18cc2c8f7c3331e9af6fe60eb7133cf249a9dfbbc93 WatchSource:0}: Error finding container 23e050a75aea13cf8cf3c18cc2c8f7c3331e9af6fe60eb7133cf249a9dfbbc93: Status 404 returned error can't find the container with id 23e050a75aea13cf8cf3c18cc2c8f7c3331e9af6fe60eb7133cf249a9dfbbc93 Sep 18 02:58:37.041795 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:37.041776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:37.041892 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:37.041806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:37.041892 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:37.041846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:37.041961 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.041935 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 02:58:37.041961 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.041949 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 18 02:58:37.042020 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.041970 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 18 02:58:37.042020 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.041979 2575 projected.go:196] Error preparing data for projected volume kube-api-access-tjp9q for pod openshift-network-diagnostics/network-check-target-h6fj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:37.042020 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.041953 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc7555d-qw2r4: secret "image-registry-tls" not found Sep 18 02:58:37.042109 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.042022 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q podName:efee14b0-15f3-4020-966b-2bb413ea6e4d nodeName:}" failed. No retries permitted until 2026-09-18 02:59:09.042005941 +0000 UTC m=+68.084329351 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tjp9q" (UniqueName: "kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q") pod "network-check-target-h6fj8" (UID: "efee14b0-15f3-4020-966b-2bb413ea6e4d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 18 02:58:37.042109 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.042063 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls podName:898cb226-e34e-48e2-8353-53070accb576 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:38.042049363 +0000 UTC m=+37.084372750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls") pod "image-registry-7cc7555d-qw2r4" (UID: "898cb226-e34e-48e2-8353-53070accb576") : secret "image-registry-tls" not found Sep 18 02:58:37.042109 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.041937 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 02:58:37.042109 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:37.042100 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls podName:1539f19e-0a38-4da7-857e-157ee37c2367 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:38.042091073 +0000 UTC m=+37.084414462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls") pod "dns-default-cm76t" (UID: "1539f19e-0a38-4da7-857e-157ee37c2367") : secret "dns-default-metrics-tls" not found Sep 18 02:58:37.424210 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:37.424184 2575 generic.go:356] "Generic (PLEG): container finished" podID="23215b09-4012-4a2d-b55c-465d0f47d190" containerID="4bd27e7f641ddf449be08666bbbac41c6d6c1e31651af56292d1efc2da8472a4" exitCode=0 Sep 18 02:58:37.424637 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:37.424246 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" event={"ID":"23215b09-4012-4a2d-b55c-465d0f47d190","Type":"ContainerDied","Data":"4bd27e7f641ddf449be08666bbbac41c6d6c1e31651af56292d1efc2da8472a4"} Sep 18 02:58:37.425524 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:37.425502 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gpm7w" event={"ID":"1922ec46-41f0-481d-9c3a-3d400b2af38d","Type":"ContainerStarted","Data":"23e050a75aea13cf8cf3c18cc2c8f7c3331e9af6fe60eb7133cf249a9dfbbc93"} Sep 18 02:58:38.049430 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.049385 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:38.049645 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.049487 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:38.049645 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:38.049555 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 02:58:38.049645 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:38.049578 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc7555d-qw2r4: secret "image-registry-tls" not found Sep 18 02:58:38.049645 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:38.049588 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 02:58:38.049645 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:38.049645 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls podName:898cb226-e34e-48e2-8353-53070accb576 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:40.049624869 +0000 UTC m=+39.091948262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls") pod "image-registry-7cc7555d-qw2r4" (UID: "898cb226-e34e-48e2-8353-53070accb576") : secret "image-registry-tls" not found Sep 18 02:58:38.049991 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:38.049665 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls podName:1539f19e-0a38-4da7-857e-157ee37c2367 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:40.049656318 +0000 UTC m=+39.091979704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls") pod "dns-default-cm76t" (UID: "1539f19e-0a38-4da7-857e-157ee37c2367") : secret "dns-default-metrics-tls" not found Sep 18 02:58:38.208016 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.207983 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:58:38.208206 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.207983 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:58:38.208206 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.207983 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:58:38.212156 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.211904 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 02:58:38.212156 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.211929 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 02:58:38.212156 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.211944 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s6zc4\"" Sep 18 02:58:38.212156 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.211968 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 02:58:38.212156 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.211929 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 02:58:38.212156 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.212050 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lcv44\"" Sep 18 02:58:38.432218 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.432186 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" event={"ID":"23215b09-4012-4a2d-b55c-465d0f47d190","Type":"ContainerStarted","Data":"384ef0c420ca5b95f3ec7654219ba31f526a7c3359d0d43e8fc34d83d6e9ac01"} Sep 18 02:58:38.458937 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.458887 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qrbr8" podStartSLOduration=9.29334534 podStartE2EDuration="35.45886786s" totalImagesPullingTime="26.16552252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:38.457545434 +0000 UTC m=+37.499868856" watchObservedRunningTime="2026-09-18 02:58:38.45886786 +0000 UTC m=+37.501191269" Sep 18 02:58:38.584379 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.584345 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:38.692561 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:38.692484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:39.435595 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:39.435564 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gpm7w" event={"ID":"1922ec46-41f0-481d-9c3a-3d400b2af38d","Type":"ContainerStarted","Data":"c538842ced4cdd2ee6630bd150f5118076c9d9e91573413333d3eb72a3deba22"} Sep 18 02:58:39.462925 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:39.462880 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gpm7w" podStartSLOduration=1.431808689 podStartE2EDuration="3.462866567s" totalImagesPullingTime="2.031057878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:39.462633463 +0000 UTC m=+38.504956883" watchObservedRunningTime="2026-09-18 02:58:39.462866567 +0000 UTC m=+38.505189975" Sep 18 02:58:40.066561 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:40.066530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:40.066644 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:40.066594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:40.066689 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:40.066677 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 02:58:40.066719 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:40.066684 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 02:58:40.066719 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:40.066703 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc7555d-qw2r4: secret "image-registry-tls" not found Sep 18 02:58:40.066787 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:40.066748 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls podName:1539f19e-0a38-4da7-857e-157ee37c2367 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:44.066715486 +0000 UTC m=+43.109038890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls") pod "dns-default-cm76t" (UID: "1539f19e-0a38-4da7-857e-157ee37c2367") : secret "dns-default-metrics-tls" not found Sep 18 02:58:40.066787 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:40.066763 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls podName:898cb226-e34e-48e2-8353-53070accb576 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:44.066756858 +0000 UTC m=+43.109080244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls") pod "image-registry-7cc7555d-qw2r4" (UID: "898cb226-e34e-48e2-8353-53070accb576") : secret "image-registry-tls" not found Sep 18 02:58:41.121897 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:41.121849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:41.218562 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:41.218530 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:41.482609 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:41.482546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:41.587699 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:41.587665 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:41.690931 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:41.690909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:42.859255 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:42.859215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:42.950739 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:42.950706 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:43.023180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.023150 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:43.894203 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.894168 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475"] Sep 18 02:58:43.898081 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.898049 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:43.907752 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.907734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" Sep 18 02:58:43.908194 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.908176 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475"] Sep 18 02:58:43.910758 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.910739 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 18 02:58:43.911029 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.911013 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 18 02:58:43.911852 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.911835 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vcvhq\"" Sep 18 02:58:43.994588 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.994569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzqpp\" (UniqueName: \"kubernetes.io/projected/fdc3ba0d-ccf2-4370-9f47-e39e437455cc-kube-api-access-gzqpp\") pod \"migrator-76794cbd6c-fn475\" (UID: \"fdc3ba0d-ccf2-4370-9f47-e39e437455cc\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" Sep 18 02:58:43.999138 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:43.999112 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:44.094847 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.094824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:44.094931 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.094848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzqpp\" (UniqueName: \"kubernetes.io/projected/fdc3ba0d-ccf2-4370-9f47-e39e437455cc-kube-api-access-gzqpp\") pod \"migrator-76794cbd6c-fn475\" (UID: \"fdc3ba0d-ccf2-4370-9f47-e39e437455cc\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" Sep 18 02:58:44.094931 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.094884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:44.095003 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.094959 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 02:58:44.095039 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.095025 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls podName:1539f19e-0a38-4da7-857e-157ee37c2367 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:52.095006649 +0000 UTC m=+51.137330059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls") pod "dns-default-cm76t" (UID: "1539f19e-0a38-4da7-857e-157ee37c2367") : secret "dns-default-metrics-tls" not found Sep 18 02:58:44.095092 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.094963 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 02:58:44.095092 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.095054 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc7555d-qw2r4: secret "image-registry-tls" not found Sep 18 02:58:44.095162 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.095100 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls podName:898cb226-e34e-48e2-8353-53070accb576 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:52.095089121 +0000 UTC m=+51.137412530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls") pod "image-registry-7cc7555d-qw2r4" (UID: "898cb226-e34e-48e2-8353-53070accb576") : secret "image-registry-tls" not found Sep 18 02:58:44.099500 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.099477 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:44.105144 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.105120 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzqpp\" (UniqueName: \"kubernetes.io/projected/fdc3ba0d-ccf2-4370-9f47-e39e437455cc-kube-api-access-gzqpp\") pod \"migrator-76794cbd6c-fn475\" (UID: \"fdc3ba0d-ccf2-4370-9f47-e39e437455cc\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" Sep 18 02:58:44.216438 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.216364 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" Sep 18 02:58:44.515453 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:58:44.515426 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc3ba0d_ccf2_4370_9f47_e39e437455cc.slice/crio-0d8cf4a2cf8db1b59bfe69c59f0d1cca496c08f8f85a6cfd5fa2d1de29ac52a5 WatchSource:0}: Error finding container 0d8cf4a2cf8db1b59bfe69c59f0d1cca496c08f8f85a6cfd5fa2d1de29ac52a5: Status 404 returned error can't find the container with id 0d8cf4a2cf8db1b59bfe69c59f0d1cca496c08f8f85a6cfd5fa2d1de29ac52a5 Sep 18 02:58:44.515868 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.515849 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475"] Sep 18 02:58:44.599096 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.599070 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mqxjt"] Sep 18 02:58:44.608018 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.607963 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:44.624900 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.624879 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqxjt"] Sep 18 02:58:44.624994 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.624976 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.628933 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.628905 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 18 02:58:44.629039 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.628905 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 18 02:58:44.629039 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.629024 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jfrrf\"" Sep 18 02:58:44.629937 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.629918 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 18 02:58:44.630130 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.629923 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 18 02:58:44.690604 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.690569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:44.799251 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.799187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf4nc\" (UniqueName: \"kubernetes.io/projected/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-api-access-qf4nc\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.799251 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.799241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/973a9b49-3e8d-49ec-bebb-dc978afdc833-data-volume\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.799469 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.799270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.799469 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.799321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.799469 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.799360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/973a9b49-3e8d-49ec-bebb-dc978afdc833-crio-socket\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.899865 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.899835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/973a9b49-3e8d-49ec-bebb-dc978afdc833-data-volume\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.899883 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.899908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.899939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/973a9b49-3e8d-49ec-bebb-dc978afdc833-crio-socket\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.899967 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.899999 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf4nc\" (UniqueName: \"kubernetes.io/projected/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-api-access-qf4nc\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.900046 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:45.400024977 +0000 UTC m=+44.442348363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : configmap "kube-rbac-proxy" not found Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.900059 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:44.900124 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:45.40011014 +0000 UTC m=+44.442433527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : secret "insights-runtime-extractor-tls" not found Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.900152 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/973a9b49-3e8d-49ec-bebb-dc978afdc833-crio-socket\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.900244 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.900228 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/973a9b49-3e8d-49ec-bebb-dc978afdc833-data-volume\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:44.910989 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:44.910966 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf4nc\" (UniqueName: \"kubernetes.io/projected/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-api-access-qf4nc\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:45.404425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:45.404378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:45.404425 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:45.404424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:45.404679 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:45.404513 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 02:58:45.404679 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:45.404583 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 02:58:45.404679 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:45.404633 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:46.404612608 +0000 UTC m=+45.446935995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : configmap "kube-rbac-proxy" not found Sep 18 02:58:45.404679 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:45.404653 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:46.404643934 +0000 UTC m=+45.446967325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : secret "insights-runtime-extractor-tls" not found Sep 18 02:58:45.450537 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:45.450510 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" event={"ID":"fdc3ba0d-ccf2-4370-9f47-e39e437455cc","Type":"ContainerStarted","Data":"0d8cf4a2cf8db1b59bfe69c59f0d1cca496c08f8f85a6cfd5fa2d1de29ac52a5"} Sep 18 02:58:46.308815 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:46.308792 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:46.408155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:46.408091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:46.414051 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:46.414030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:46.414119 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:46.414065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:46.414162 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:46.414132 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 02:58:46.414210 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:46.414161 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 02:58:46.414210 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:46.414179 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:48.414164135 +0000 UTC m=+47.456487521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : configmap "kube-rbac-proxy" not found Sep 18 02:58:46.414210 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:46.414201 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:48.414188326 +0000 UTC m=+47.456511739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : secret "insights-runtime-extractor-tls" not found Sep 18 02:58:46.454044 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:46.453995 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" event={"ID":"fdc3ba0d-ccf2-4370-9f47-e39e437455cc","Type":"ContainerStarted","Data":"0b169f7f0cfcd73e8380c95e5f568b13d02d0717130e5e234dbfb7fdcdfdc902"} Sep 18 02:58:46.454137 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:46.454043 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" event={"ID":"fdc3ba0d-ccf2-4370-9f47-e39e437455cc","Type":"ContainerStarted","Data":"fbb25b5edcc0c16c71af44b25d6358b2e0e5bd8cc667f47dcd408e9f4b615a40"} Sep 18 02:58:46.471905 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:46.471862 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-fn475" podStartSLOduration=1.7852295919999999 podStartE2EDuration="3.471847087s" totalImagesPullingTime="1.686617495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:58:46.471231227 +0000 UTC m=+45.513554629" watchObservedRunningTime="2026-09-18 02:58:46.471847087 +0000 UTC m=+45.514170497" Sep 18 02:58:46.558655 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:46.558624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:47.338078 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:47.338051 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qsvwf_8f7b1f69-de0d-472c-b7be-22cb32331ca2/dns-node-resolver/0.log" Sep 18 02:58:47.684428 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:47.684343 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:48.136736 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:48.136708 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-579bg_b28acd24-e9d1-4daa-8f28-edefbacbda56/node-ca/0.log" Sep 18 02:58:48.430374 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:48.430304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:48.430374 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:48.430337 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:48.430869 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:48.430443 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 18 02:58:48.430869 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:48.430456 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 02:58:48.430869 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:48.430512 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:52.430495954 +0000 UTC m=+51.472819405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : configmap "kube-rbac-proxy" not found Sep 18 02:58:48.430869 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:48.430531 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:58:52.430525125 +0000 UTC m=+51.472848569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : secret "insights-runtime-extractor-tls" not found Sep 18 02:58:48.696824 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:48.696756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:48.796055 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:48.796015 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:49.136605 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:49.136571 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gpm7w_1922ec46-41f0-481d-9c3a-3d400b2af38d/serve-healthcheck-canary/0.log" Sep 18 02:58:49.258892 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:49.258859 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:49.538213 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:49.538152 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-fn475_fdc3ba0d-ccf2-4370-9f47-e39e437455cc/migrator/0.log" Sep 18 02:58:49.734774 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:49.734752 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-fn475_fdc3ba0d-ccf2-4370-9f47-e39e437455cc/graceful-termination/0.log" Sep 18 02:58:51.260325 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:51.260292 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:51.372353 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:51.372320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:51.608172 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:51.608140 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:51.706652 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:51.706616 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:51.818061 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:51.818014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:52.086713 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:52.086681 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:52.155467 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:52.155441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:58:52.155578 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:52.155496 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:58:52.155621 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:52.155586 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 18 02:58:52.155621 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:52.155601 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cc7555d-qw2r4: secret "image-registry-tls" not found Sep 18 02:58:52.155621 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:52.155605 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 18 02:58:52.155709 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:52.155648 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls podName:1539f19e-0a38-4da7-857e-157ee37c2367 nodeName:}" failed. No retries permitted until 2026-09-18 02:59:08.155636263 +0000 UTC m=+67.197959649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls") pod "dns-default-cm76t" (UID: "1539f19e-0a38-4da7-857e-157ee37c2367") : secret "dns-default-metrics-tls" not found Sep 18 02:58:52.155709 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:52.155660 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls podName:898cb226-e34e-48e2-8353-53070accb576 nodeName:}" failed. No retries permitted until 2026-09-18 02:59:08.155654705 +0000 UTC m=+67.197978091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls") pod "image-registry-7cc7555d-qw2r4" (UID: "898cb226-e34e-48e2-8353-53070accb576") : secret "image-registry-tls" not found Sep 18 02:58:52.457949 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:52.457875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:52.457949 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:52.457910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:52.458377 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:52.458002 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 18 02:58:52.458377 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:58:52.458054 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls podName:973a9b49-3e8d-49ec-bebb-dc978afdc833 nodeName:}" failed. No retries permitted until 2026-09-18 02:59:00.458040324 +0000 UTC m=+59.500363710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqxjt" (UID: "973a9b49-3e8d-49ec-bebb-dc978afdc833") : secret "insights-runtime-extractor-tls" not found Sep 18 02:58:52.458506 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:52.458486 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/973a9b49-3e8d-49ec-bebb-dc978afdc833-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:58:53.268058 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:53.268027 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:53.456060 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:53.456023 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:53.654212 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:53.654181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:53.854050 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:53.854017 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:54.051188 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:54.051105 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:54.949601 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:54.949551 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:55.050316 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:55.050285 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:55.126059 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:55.126034 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:55.445298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:55.445273 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:55.657320 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:55.657291 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:55.852730 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:55.852701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:55.931210 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:55.931178 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:56.251068 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:56.250991 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:57.051130 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:57.051097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:57.483355 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:57.483325 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:57.657500 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:57.657469 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:57.729985 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:57.729952 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:57.856220 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:57.856192 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:58.050990 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:58.050961 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:59.062691 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:59.062656 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:59.143208 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:59.143177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:59.452670 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:59.452626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:59.663008 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:59.662979 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:59.857298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:59.857262 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:58:59.963846 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:58:59.963815 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:00.058553 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:00.058529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:00.134444 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:00.134343 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:00.514637 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:00.514567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:59:00.516620 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:00.516591 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/973a9b49-3e8d-49ec-bebb-dc978afdc833-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqxjt\" (UID: \"973a9b49-3e8d-49ec-bebb-dc978afdc833\") " pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:59:00.534716 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:00.534691 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqxjt" Sep 18 02:59:00.815700 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:00.815679 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqxjt"] Sep 18 02:59:00.818942 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:00.818920 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973a9b49_3e8d_49ec_bebb_dc978afdc833.slice/crio-7e6b4907e15351d71e48474f4580d4a1326bdf49af2e2c1a3327599c42eb62cc WatchSource:0}: Error finding container 7e6b4907e15351d71e48474f4580d4a1326bdf49af2e2c1a3327599c42eb62cc: Status 404 returned error can't find the container with id 7e6b4907e15351d71e48474f4580d4a1326bdf49af2e2c1a3327599c42eb62cc Sep 18 02:59:01.095606 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:01.095516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:01.454728 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:01.454638 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:01.491368 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:01.491334 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqxjt" event={"ID":"973a9b49-3e8d-49ec-bebb-dc978afdc833","Type":"ContainerStarted","Data":"c6ed40da75f9d87fc8761f50e3550a722f93d354ec44cf62790f04c29db17248"} Sep 18 02:59:01.491513 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:01.491393 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqxjt" event={"ID":"973a9b49-3e8d-49ec-bebb-dc978afdc833","Type":"ContainerStarted","Data":"7e6b4907e15351d71e48474f4580d4a1326bdf49af2e2c1a3327599c42eb62cc"} Sep 18 02:59:01.657380 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:01.657350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:01.849497 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:01.849470 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:02.065472 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:02.065436 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:02.417894 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:02.417867 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nvdqj" Sep 18 02:59:02.496394 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:02.496364 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqxjt" event={"ID":"973a9b49-3e8d-49ec-bebb-dc978afdc833","Type":"ContainerStarted","Data":"4d1583c7b698e389d3adcdab8db2b713523103af4aa19cdb420413ef325d28fc"} Sep 18 02:59:03.500700 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:03.500665 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqxjt" event={"ID":"973a9b49-3e8d-49ec-bebb-dc978afdc833","Type":"ContainerStarted","Data":"07e6fc3aa42db748466a05a735f0ba5a84eee2bf3646f15463d1dc3b283c7705"} Sep 18 02:59:03.521339 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:03.521296 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mqxjt" podStartSLOduration=17.726561954 podStartE2EDuration="19.521283498s" totalImagesPullingTime="1.794721544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:03.519862222 +0000 UTC m=+62.562185630" watchObservedRunningTime="2026-09-18 02:59:03.521283498 +0000 UTC m=+62.563606906" Sep 18 02:59:08.078117 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.078074 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5"] Sep 18 02:59:08.080835 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.080811 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.084206 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.084167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 18 02:59:08.084961 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.084942 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 18 02:59:08.085461 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.085435 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 18 02:59:08.086057 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.086039 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 18 02:59:08.098340 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.098313 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5"] Sep 18 02:59:08.125401 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.125372 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cc7555d-qw2r4"] Sep 18 02:59:08.125587 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:08.125565 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" podUID="898cb226-e34e-48e2-8353-53070accb576" Sep 18 02:59:08.165175 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.165147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:59:08.165298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.165202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/15c75660-e6c2-43d5-a4b9-27f485680179-klusterlet-config\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.165298 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.165271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:59:08.165379 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.165319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15c75660-e6c2-43d5-a4b9-27f485680179-tmp\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.165379 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.165336 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqjq5\" (UniqueName: \"kubernetes.io/projected/15c75660-e6c2-43d5-a4b9-27f485680179-kube-api-access-kqjq5\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.167617 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.167594 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1539f19e-0a38-4da7-857e-157ee37c2367-metrics-tls\") pod \"dns-default-cm76t\" (UID: \"1539f19e-0a38-4da7-857e-157ee37c2367\") " pod="openshift-dns/dns-default-cm76t" Sep 18 02:59:08.167707 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.167636 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"image-registry-7cc7555d-qw2r4\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:59:08.177435 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.177396 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5964f9b69b-nljrv"] Sep 18 02:59:08.180654 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.180635 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.196125 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.196098 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5964f9b69b-nljrv"] Sep 18 02:59:08.246483 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.246448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:08.266462 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266440 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/15c75660-e6c2-43d5-a4b9-27f485680179-klusterlet-config\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.266550 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-installation-pull-secrets\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.266550 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266495 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-bound-sa-token\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.266550 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266511 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-trusted-ca\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.266550 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266550 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-ca-trust-extracted\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.266750 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-registry-tls\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.266750 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-image-registry-private-configuration\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.266750 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66h8p\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-kube-api-access-66h8p\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.266892 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266752 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-registry-certificates\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.266892 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15c75660-e6c2-43d5-a4b9-27f485680179-tmp\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.266892 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.266806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqjq5\" (UniqueName: \"kubernetes.io/projected/15c75660-e6c2-43d5-a4b9-27f485680179-kube-api-access-kqjq5\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.267156 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.267136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15c75660-e6c2-43d5-a4b9-27f485680179-tmp\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.269057 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.269026 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/15c75660-e6c2-43d5-a4b9-27f485680179-klusterlet-config\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.276269 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.276246 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqjq5\" (UniqueName: \"kubernetes.io/projected/15c75660-e6c2-43d5-a4b9-27f485680179-kube-api-access-kqjq5\") pod \"klusterlet-addon-workmgr-f8ddd6648-q65s5\" (UID: \"15c75660-e6c2-43d5-a4b9-27f485680179\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.346449 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.346393 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:08.367565 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.367546 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-registry-tls\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.367638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.367584 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-image-registry-private-configuration\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.367638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.367603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66h8p\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-kube-api-access-66h8p\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.367638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.367631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-registry-certificates\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.367764 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.367691 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-installation-pull-secrets\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.367764 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.367715 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-bound-sa-token\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.367764 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.367737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-trusted-ca\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.367931 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.367863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-ca-trust-extracted\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.368257 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.368233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-ca-trust-extracted\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.368629 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.368606 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-registry-certificates\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.368713 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.368663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-trusted-ca\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.369875 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.369853 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-registry-tls\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.369953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.369896 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-installation-pull-secrets\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.370014 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.369989 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-image-registry-private-configuration\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.378099 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.378079 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-bound-sa-token\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.380242 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.380227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66h8p\" (UniqueName: \"kubernetes.io/projected/63070dad-3cd7-4ac3-b37a-f5aa30a9b95c-kube-api-access-66h8p\") pod \"image-registry-5964f9b69b-nljrv\" (UID: \"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c\") " pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.391071 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.391053 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:08.466109 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.466083 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:08.476307 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.476288 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jzrm7\"" Sep 18 02:59:08.478388 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.478369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cm76t" Sep 18 02:59:08.499401 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.499381 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fwll5\"" Sep 18 02:59:08.505783 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.505767 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:08.516152 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.516136 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:59:08.541241 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.541221 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:59:08.567647 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.567303 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:08.569529 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.569503 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc6dz\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-kube-api-access-mc6dz\") pod \"898cb226-e34e-48e2-8353-53070accb576\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " Sep 18 02:59:08.569906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.569743 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/898cb226-e34e-48e2-8353-53070accb576-ca-trust-extracted\") pod \"898cb226-e34e-48e2-8353-53070accb576\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " Sep 18 02:59:08.569906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.569801 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-registry-certificates\") pod \"898cb226-e34e-48e2-8353-53070accb576\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " Sep 18 02:59:08.569906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.569848 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-bound-sa-token\") pod \"898cb226-e34e-48e2-8353-53070accb576\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " Sep 18 02:59:08.569906 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.569880 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-installation-pull-secrets\") pod \"898cb226-e34e-48e2-8353-53070accb576\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " Sep 18 02:59:08.570188 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.569915 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-trusted-ca\") pod \"898cb226-e34e-48e2-8353-53070accb576\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " Sep 18 02:59:08.570188 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.569943 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-image-registry-private-configuration\") pod \"898cb226-e34e-48e2-8353-53070accb576\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " Sep 18 02:59:08.570188 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.569988 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") pod \"898cb226-e34e-48e2-8353-53070accb576\" (UID: \"898cb226-e34e-48e2-8353-53070accb576\") " Sep 18 02:59:08.570188 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.570162 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/898cb226-e34e-48e2-8353-53070accb576-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "898cb226-e34e-48e2-8353-53070accb576" (UID: "898cb226-e34e-48e2-8353-53070accb576"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 02:59:08.570950 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.570757 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "898cb226-e34e-48e2-8353-53070accb576" (UID: "898cb226-e34e-48e2-8353-53070accb576"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 02:59:08.571757 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.571623 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "898cb226-e34e-48e2-8353-53070accb576" (UID: "898cb226-e34e-48e2-8353-53070accb576"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 02:59:08.572842 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.572799 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-kube-api-access-mc6dz" (OuterVolumeSpecName: "kube-api-access-mc6dz") pod "898cb226-e34e-48e2-8353-53070accb576" (UID: "898cb226-e34e-48e2-8353-53070accb576"). InnerVolumeSpecName "kube-api-access-mc6dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 02:59:08.576696 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.576575 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "898cb226-e34e-48e2-8353-53070accb576" (UID: "898cb226-e34e-48e2-8353-53070accb576"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 02:59:08.576696 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.576638 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "898cb226-e34e-48e2-8353-53070accb576" (UID: "898cb226-e34e-48e2-8353-53070accb576"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 02:59:08.576696 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.576660 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "898cb226-e34e-48e2-8353-53070accb576" (UID: "898cb226-e34e-48e2-8353-53070accb576"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 02:59:08.578449 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.577221 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "898cb226-e34e-48e2-8353-53070accb576" (UID: "898cb226-e34e-48e2-8353-53070accb576"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 02:59:08.665078 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.665022 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:08.671088 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.671070 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-registry-tls\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 02:59:08.671088 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.671088 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc6dz\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-kube-api-access-mc6dz\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 02:59:08.671198 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.671102 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/898cb226-e34e-48e2-8353-53070accb576-ca-trust-extracted\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 02:59:08.671198 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.671117 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-registry-certificates\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 02:59:08.671198 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.671126 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/898cb226-e34e-48e2-8353-53070accb576-bound-sa-token\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 02:59:08.671198 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.671134 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-installation-pull-secrets\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 02:59:08.671198 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.671141 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/898cb226-e34e-48e2-8353-53070accb576-trusted-ca\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 02:59:08.671198 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.671150 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/898cb226-e34e-48e2-8353-53070accb576-image-registry-private-configuration\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 02:59:08.702767 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.702744 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5"] Sep 18 02:59:08.706160 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:08.706138 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c75660_e6c2_43d5_a4b9_27f485680179.slice/crio-11aa503adabbb50dc29d87c821f8a398dfb9fd89e03a7081bd8a7b5eec05150d WatchSource:0}: Error finding container 11aa503adabbb50dc29d87c821f8a398dfb9fd89e03a7081bd8a7b5eec05150d: Status 404 returned error can't find the container with id 11aa503adabbb50dc29d87c821f8a398dfb9fd89e03a7081bd8a7b5eec05150d Sep 18 02:59:08.786395 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.786372 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cm76t"] Sep 18 02:59:08.789625 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:08.789603 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1539f19e_0a38_4da7_857e_157ee37c2367.slice/crio-68a557941a76691470f23313d06f2b67a34e64d52158025d8f22bb087dcab786 WatchSource:0}: Error finding container 68a557941a76691470f23313d06f2b67a34e64d52158025d8f22bb087dcab786: Status 404 returned error can't find the container with id 68a557941a76691470f23313d06f2b67a34e64d52158025d8f22bb087dcab786 Sep 18 02:59:08.806374 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.806330 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5964f9b69b-nljrv"] Sep 18 02:59:08.808432 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:08.808396 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63070dad_3cd7_4ac3_b37a_f5aa30a9b95c.slice/crio-68ac068f54c09e39093aebbb78d2acd586460d2accd0b71c7740ae0be2bd7aab WatchSource:0}: Error finding container 68ac068f54c09e39093aebbb78d2acd586460d2accd0b71c7740ae0be2bd7aab: Status 404 returned error can't find the container with id 68ac068f54c09e39093aebbb78d2acd586460d2accd0b71c7740ae0be2bd7aab Sep 18 02:59:08.872193 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.872170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:59:08.874770 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.874753 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 18 02:59:08.884267 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.884244 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ede2701f-9c64-4a2b-9679-ee282f6106e2-original-pull-secret\") pod \"global-pull-secret-syncer-bd45r\" (UID: \"ede2701f-9c64-4a2b-9679-ee282f6106e2\") " pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:59:08.972867 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.972819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:59:08.975612 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.975597 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 18 02:59:08.985612 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:08.985595 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f815a6e0-6f48-49c4-8e9c-257843eb3eed-metrics-certs\") pod \"network-metrics-daemon-h2h9j\" (UID: \"f815a6e0-6f48-49c4-8e9c-257843eb3eed\") " pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:59:09.073336 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.073316 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:59:09.075872 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.075856 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 18 02:59:09.087199 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.087182 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 18 02:59:09.097050 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.097031 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjp9q\" (UniqueName: \"kubernetes.io/projected/efee14b0-15f3-4020-966b-2bb413ea6e4d-kube-api-access-tjp9q\") pod \"network-check-target-h6fj8\" (UID: \"efee14b0-15f3-4020-966b-2bb413ea6e4d\") " pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:59:09.121661 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.121640 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s6zc4\"" Sep 18 02:59:09.127379 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.127359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lcv44\"" Sep 18 02:59:09.128443 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.128404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:59:09.131572 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.131558 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bd45r" Sep 18 02:59:09.135452 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.135436 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h2h9j" Sep 18 02:59:09.409593 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.409567 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bd45r"] Sep 18 02:59:09.412905 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:09.412883 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede2701f_9c64_4a2b_9679_ee282f6106e2.slice/crio-5485babc341cf82b32dabec120c660daf5b5a4fed317509997c3ab39f8956ac5 WatchSource:0}: Error finding container 5485babc341cf82b32dabec120c660daf5b5a4fed317509997c3ab39f8956ac5: Status 404 returned error can't find the container with id 5485babc341cf82b32dabec120c660daf5b5a4fed317509997c3ab39f8956ac5 Sep 18 02:59:09.417785 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.417723 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h6fj8"] Sep 18 02:59:09.423097 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:09.423067 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefee14b0_15f3_4020_966b_2bb413ea6e4d.slice/crio-1d915aaf21641ec1cc958c6ccd24a34dcbec494c334a78c30fc12ba596d97afb WatchSource:0}: Error finding container 1d915aaf21641ec1cc958c6ccd24a34dcbec494c334a78c30fc12ba596d97afb: Status 404 returned error can't find the container with id 1d915aaf21641ec1cc958c6ccd24a34dcbec494c334a78c30fc12ba596d97afb Sep 18 02:59:09.444934 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.444907 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h2h9j"] Sep 18 02:59:09.448652 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:09.448618 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf815a6e0_6f48_49c4_8e9c_257843eb3eed.slice/crio-e12b4b428bf396243f19dd7b2d5f2c3ceb8e7ee7468ee4b820e3f039800eb403 WatchSource:0}: Error finding container e12b4b428bf396243f19dd7b2d5f2c3ceb8e7ee7468ee4b820e3f039800eb403: Status 404 returned error can't find the container with id e12b4b428bf396243f19dd7b2d5f2c3ceb8e7ee7468ee4b820e3f039800eb403 Sep 18 02:59:09.521017 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.520947 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h6fj8" event={"ID":"efee14b0-15f3-4020-966b-2bb413ea6e4d","Type":"ContainerStarted","Data":"1d915aaf21641ec1cc958c6ccd24a34dcbec494c334a78c30fc12ba596d97afb"} Sep 18 02:59:09.522273 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.522242 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cm76t" event={"ID":"1539f19e-0a38-4da7-857e-157ee37c2367","Type":"ContainerStarted","Data":"68a557941a76691470f23313d06f2b67a34e64d52158025d8f22bb087dcab786"} Sep 18 02:59:09.523453 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.523427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h2h9j" event={"ID":"f815a6e0-6f48-49c4-8e9c-257843eb3eed","Type":"ContainerStarted","Data":"e12b4b428bf396243f19dd7b2d5f2c3ceb8e7ee7468ee4b820e3f039800eb403"} Sep 18 02:59:09.525846 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.525429 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" event={"ID":"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c","Type":"ContainerStarted","Data":"8358f3812eeaab987ac4df16c90ff781cd0f561b44ba14f31dde6f2e087d8d84"} Sep 18 02:59:09.525846 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.525475 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" event={"ID":"63070dad-3cd7-4ac3-b37a-f5aa30a9b95c","Type":"ContainerStarted","Data":"68ac068f54c09e39093aebbb78d2acd586460d2accd0b71c7740ae0be2bd7aab"} Sep 18 02:59:09.525846 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.525548 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:09.526813 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.526782 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bd45r" event={"ID":"ede2701f-9c64-4a2b-9679-ee282f6106e2","Type":"ContainerStarted","Data":"5485babc341cf82b32dabec120c660daf5b5a4fed317509997c3ab39f8956ac5"} Sep 18 02:59:09.528114 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.528095 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cc7555d-qw2r4" Sep 18 02:59:09.528114 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.528106 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" event={"ID":"15c75660-e6c2-43d5-a4b9-27f485680179","Type":"ContainerStarted","Data":"11aa503adabbb50dc29d87c821f8a398dfb9fd89e03a7081bd8a7b5eec05150d"} Sep 18 02:59:09.557371 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.556551 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" podStartSLOduration=1.5565390300000002 podStartE2EDuration="1.55653903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:09.556489622 +0000 UTC m=+68.598813030" watchObservedRunningTime="2026-09-18 02:59:09.55653903 +0000 UTC m=+68.598862429" Sep 18 02:59:09.590462 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.590403 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cc7555d-qw2r4"] Sep 18 02:59:09.596097 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:09.596073 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cc7555d-qw2r4"] Sep 18 02:59:11.171976 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.171921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:11.213454 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.213236 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="898cb226-e34e-48e2-8353-53070accb576" path="/var/lib/kubelet/pods/898cb226-e34e-48e2-8353-53070accb576/volumes" Sep 18 02:59:11.274254 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.274190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:11.355790 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.355759 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf"] Sep 18 02:59:11.360445 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.360403 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" Sep 18 02:59:11.364848 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.364455 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qdgwx\"" Sep 18 02:59:11.364848 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.364697 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 18 02:59:11.367565 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.367538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:11.368480 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.368432 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf"] Sep 18 02:59:11.389930 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.389903 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1b79989-d71d-478e-bce2-1f9d5ebbdbe8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9tksf\" (UID: \"a1b79989-d71d-478e-bce2-1f9d5ebbdbe8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" Sep 18 02:59:11.490952 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.490879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1b79989-d71d-478e-bce2-1f9d5ebbdbe8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9tksf\" (UID: \"a1b79989-d71d-478e-bce2-1f9d5ebbdbe8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" Sep 18 02:59:11.491089 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:11.491053 2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 18 02:59:11.491156 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:11.491131 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b79989-d71d-478e-bce2-1f9d5ebbdbe8-tls-certificates podName:a1b79989-d71d-478e-bce2-1f9d5ebbdbe8 nodeName:}" failed. No retries permitted until 2026-09-18 02:59:11.991109118 +0000 UTC m=+71.033432517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a1b79989-d71d-478e-bce2-1f9d5ebbdbe8-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-9tksf" (UID: "a1b79989-d71d-478e-bce2-1f9d5ebbdbe8") : secret "prometheus-operator-admission-webhook-tls" not found Sep 18 02:59:11.918716 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.918671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:11.994958 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:11.994923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1b79989-d71d-478e-bce2-1f9d5ebbdbe8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9tksf\" (UID: \"a1b79989-d71d-478e-bce2-1f9d5ebbdbe8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" Sep 18 02:59:12.000088 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:12.000061 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a1b79989-d71d-478e-bce2-1f9d5ebbdbe8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-9tksf\" (UID: \"a1b79989-d71d-478e-bce2-1f9d5ebbdbe8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" Sep 18 02:59:12.066022 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:12.065987 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:12.142082 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:12.142020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:12.277651 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:12.277581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" Sep 18 02:59:14.576967 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:14.576930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:14.679840 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:14.679805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:14.753790 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:14.753755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:14.957177 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:14.957015 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:15.030958 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:15.030907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:16.158814 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.158607 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf"] Sep 18 02:59:16.164264 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:16.164228 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b79989_d71d_478e_bce2_1f9d5ebbdbe8.slice/crio-0f20a58cefa45cc84f13ffd577ce343b600e4c9fa43727f00dc5892edd55de12 WatchSource:0}: Error finding container 0f20a58cefa45cc84f13ffd577ce343b600e4c9fa43727f00dc5892edd55de12: Status 404 returned error can't find the container with id 0f20a58cefa45cc84f13ffd577ce343b600e4c9fa43727f00dc5892edd55de12 Sep 18 02:59:16.558419 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.558324 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h2h9j" event={"ID":"f815a6e0-6f48-49c4-8e9c-257843eb3eed","Type":"ContainerStarted","Data":"006284e7ef28028c0fd3bde17893c6cc5f5cad394e45f9d46ca15fb03ec92bc7"} Sep 18 02:59:16.558419 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.558386 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h2h9j" event={"ID":"f815a6e0-6f48-49c4-8e9c-257843eb3eed","Type":"ContainerStarted","Data":"b8339315257966d9bbb72e79392843a018ef7f5cbf2b0c340d7f45a56e790580"} Sep 18 02:59:16.559877 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.559849 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" event={"ID":"a1b79989-d71d-478e-bce2-1f9d5ebbdbe8","Type":"ContainerStarted","Data":"0f20a58cefa45cc84f13ffd577ce343b600e4c9fa43727f00dc5892edd55de12"} Sep 18 02:59:16.561899 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.561873 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bd45r" event={"ID":"ede2701f-9c64-4a2b-9679-ee282f6106e2","Type":"ContainerStarted","Data":"c769eb3a21fd28470cd306b722f4f15d23b728eae2eb53ba53ba798cab188e31"} Sep 18 02:59:16.567521 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.567499 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" event={"ID":"15c75660-e6c2-43d5-a4b9-27f485680179","Type":"ContainerStarted","Data":"acc491509adcb51cf809ea69ad5af23fb578d4c6c90754777c6274847b965c4f"} Sep 18 02:59:16.568140 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.568119 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:16.569626 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.569605 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" Sep 18 02:59:16.569738 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.569645 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h6fj8" event={"ID":"efee14b0-15f3-4020-966b-2bb413ea6e4d","Type":"ContainerStarted","Data":"871c269bdf1ba92354cfb318f6cab732cb771ec1d3b43830a243b736da7b0ad3"} Sep 18 02:59:16.569992 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.569971 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:59:16.572206 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.572181 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cm76t" event={"ID":"1539f19e-0a38-4da7-857e-157ee37c2367","Type":"ContainerStarted","Data":"f81876a34d3bb55b35ae9d4397f705d0caa697e8d8ab78c0230669a18d5e07bd"} Sep 18 02:59:16.572314 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.572226 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cm76t" event={"ID":"1539f19e-0a38-4da7-857e-157ee37c2367","Type":"ContainerStarted","Data":"d25d68bcedefd3ca905843cabae52ac877f907aa8785e56070a36803aa4fefce"} Sep 18 02:59:16.572369 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.572335 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cm76t" Sep 18 02:59:16.578895 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.578848 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h2h9j" podStartSLOduration=67.149269372 podStartE2EDuration="1m13.578831505s" totalImagesPullingTime="6.429562133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:16.576797931 +0000 UTC m=+75.619121342" watchObservedRunningTime="2026-09-18 02:59:16.578831505 +0000 UTC m=+75.621154917" Sep 18 02:59:16.597309 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.597268 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cm76t" podStartSLOduration=33.519023212 podStartE2EDuration="40.59725168s" totalImagesPullingTime="7.078228468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:16.595506168 +0000 UTC m=+75.637829588" watchObservedRunningTime="2026-09-18 02:59:16.59725168 +0000 UTC m=+75.639575090" Sep 18 02:59:16.612325 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.612280 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bd45r" podStartSLOduration=67.130204556 podStartE2EDuration="1m13.61226402s" totalImagesPullingTime="6.482059464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:16.611546707 +0000 UTC m=+75.653870115" watchObservedRunningTime="2026-09-18 02:59:16.61226402 +0000 UTC m=+75.654587423" Sep 18 02:59:16.632807 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.632762 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h6fj8" podStartSLOduration=67.159535402 podStartE2EDuration="1m13.632743049s" totalImagesPullingTime="6.473207647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:16.63176764 +0000 UTC m=+75.674091051" watchObservedRunningTime="2026-09-18 02:59:16.632743049 +0000 UTC m=+75.675066459" Sep 18 02:59:16.650012 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.649972 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f8ddd6648-q65s5" podStartSLOduration=1.460123779 podStartE2EDuration="8.64996053s" totalImagesPullingTime="7.189836751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:16.649809612 +0000 UTC m=+75.692133020" watchObservedRunningTime="2026-09-18 02:59:16.64996053 +0000 UTC m=+75.692283938" Sep 18 02:59:16.694930 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.694869 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:16.793774 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:16.793745 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:17.231180 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.231134 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-p7gx9"] Sep 18 02:59:17.234239 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.234224 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-p7gx9" Sep 18 02:59:17.238226 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.238207 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 18 02:59:17.238357 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.238253 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cw8wk\"" Sep 18 02:59:17.241122 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.241104 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 18 02:59:17.255494 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.255473 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-p7gx9"] Sep 18 02:59:17.260618 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.260598 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:17.334363 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.334337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h6dc\" (UniqueName: \"kubernetes.io/projected/507ca8a3-229b-414c-891f-facc065ad04b-kube-api-access-8h6dc\") pod \"downloads-6594f4c75-p7gx9\" (UID: \"507ca8a3-229b-414c-891f-facc065ad04b\") " pod="openshift-console/downloads-6594f4c75-p7gx9" Sep 18 02:59:17.364131 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.364075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:17.434895 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.434873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h6dc\" (UniqueName: \"kubernetes.io/projected/507ca8a3-229b-414c-891f-facc065ad04b-kube-api-access-8h6dc\") pod \"downloads-6594f4c75-p7gx9\" (UID: \"507ca8a3-229b-414c-891f-facc065ad04b\") " pod="openshift-console/downloads-6594f4c75-p7gx9" Sep 18 02:59:17.444953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.444928 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h6dc\" (UniqueName: \"kubernetes.io/projected/507ca8a3-229b-414c-891f-facc065ad04b-kube-api-access-8h6dc\") pod \"downloads-6594f4c75-p7gx9\" (UID: \"507ca8a3-229b-414c-891f-facc065ad04b\") " pod="openshift-console/downloads-6594f4c75-p7gx9" Sep 18 02:59:17.523951 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.523927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:17.542444 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.542422 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-p7gx9" Sep 18 02:59:17.581423 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.581375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" event={"ID":"a1b79989-d71d-478e-bce2-1f9d5ebbdbe8","Type":"ContainerStarted","Data":"f758ac3b3ef728652c8bb77115172f34e00c2a206da7046fb85a4c61872ef205"} Sep 18 02:59:17.581544 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.581528 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" Sep 18 02:59:17.586201 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.586182 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" Sep 18 02:59:17.599339 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.599300 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-9tksf" podStartSLOduration=5.666126369 podStartE2EDuration="6.599286175s" totalImagesPullingTime="933.159806ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:17.598122327 +0000 UTC m=+76.640445736" watchObservedRunningTime="2026-09-18 02:59:17.599286175 +0000 UTC m=+76.641609584" Sep 18 02:59:17.699023 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.698940 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:17.775592 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.775567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:17.816393 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.816377 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-p7gx9"] Sep 18 02:59:17.818429 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:17.818393 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507ca8a3_229b_414c_891f_facc065ad04b.slice/crio-1fa8613149e66b2ea98f9a91dff26da4df2e95bc88216ba1b6e6004cbd6b2a53 WatchSource:0}: Error finding container 1fa8613149e66b2ea98f9a91dff26da4df2e95bc88216ba1b6e6004cbd6b2a53: Status 404 returned error can't find the container with id 1fa8613149e66b2ea98f9a91dff26da4df2e95bc88216ba1b6e6004cbd6b2a53 Sep 18 02:59:17.912179 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:17.912153 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:18.127647 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.127625 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:18.320376 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.320352 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:18.429489 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.429404 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:18.456613 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.456588 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz"] Sep 18 02:59:18.459905 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.459887 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.463813 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.463792 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 18 02:59:18.464817 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.464729 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 18 02:59:18.464817 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.464776 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 18 02:59:18.465032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.465008 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vvgt5\"" Sep 18 02:59:18.465150 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.465112 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 18 02:59:18.465249 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.465205 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 18 02:59:18.475280 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.475260 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz"] Sep 18 02:59:18.539485 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.539452 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:18.543447 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.543394 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07a68a89-2afc-4c9e-b12c-1065f86e9864-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.543540 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.543463 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/07a68a89-2afc-4c9e-b12c-1065f86e9864-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.543540 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.543523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07a68a89-2afc-4c9e-b12c-1065f86e9864-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.543658 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.543562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn6r5\" (UniqueName: \"kubernetes.io/projected/07a68a89-2afc-4c9e-b12c-1065f86e9864-kube-api-access-dn6r5\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.585902 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.585851 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-p7gx9" event={"ID":"507ca8a3-229b-414c-891f-facc065ad04b","Type":"ContainerStarted","Data":"1fa8613149e66b2ea98f9a91dff26da4df2e95bc88216ba1b6e6004cbd6b2a53"} Sep 18 02:59:18.609780 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.609748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:18.644755 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.644729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn6r5\" (UniqueName: \"kubernetes.io/projected/07a68a89-2afc-4c9e-b12c-1065f86e9864-kube-api-access-dn6r5\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.644849 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.644799 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07a68a89-2afc-4c9e-b12c-1065f86e9864-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.645076 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.645043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/07a68a89-2afc-4c9e-b12c-1065f86e9864-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.645157 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.645089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07a68a89-2afc-4c9e-b12c-1065f86e9864-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.645795 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.645758 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07a68a89-2afc-4c9e-b12c-1065f86e9864-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.647621 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.647598 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07a68a89-2afc-4c9e-b12c-1065f86e9864-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.647708 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.647691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/07a68a89-2afc-4c9e-b12c-1065f86e9864-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.655037 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.655011 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn6r5\" (UniqueName: \"kubernetes.io/projected/07a68a89-2afc-4c9e-b12c-1065f86e9864-kube-api-access-dn6r5\") pod \"prometheus-operator-7bd5d56d6-gzvgz\" (UID: \"07a68a89-2afc-4c9e-b12c-1065f86e9864\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:18.692641 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.692546 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:18.770920 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:18.770888 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" Sep 18 02:59:19.053204 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:19.053068 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz"] Sep 18 02:59:19.055485 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:19.055450 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a68a89_2afc_4c9e_b12c_1065f86e9864.slice/crio-7a503ec528db4b5c4ed9185d1a9923de092e9a37bdaa80a668c82afa1faac603 WatchSource:0}: Error finding container 7a503ec528db4b5c4ed9185d1a9923de092e9a37bdaa80a668c82afa1faac603: Status 404 returned error can't find the container with id 7a503ec528db4b5c4ed9185d1a9923de092e9a37bdaa80a668c82afa1faac603 Sep 18 02:59:19.118068 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:19.118031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:19.316436 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:19.316392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:19.431300 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:19.431254 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:19.590664 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:19.590587 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" event={"ID":"07a68a89-2afc-4c9e-b12c-1065f86e9864","Type":"ContainerStarted","Data":"7a503ec528db4b5c4ed9185d1a9923de092e9a37bdaa80a668c82afa1faac603"} Sep 18 02:59:20.330886 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:20.330831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:20.431136 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:20.431071 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:20.597405 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:20.597342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" event={"ID":"07a68a89-2afc-4c9e-b12c-1065f86e9864","Type":"ContainerStarted","Data":"11330ca777cc3694a05b68cad8411f26e5bdc598fc0f93b8ce261517faf6bbb5"} Sep 18 02:59:20.597793 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:20.597424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" event={"ID":"07a68a89-2afc-4c9e-b12c-1065f86e9864","Type":"ContainerStarted","Data":"004f06bb5106012f6d22cbfbc94ce31390389a2f1874c5b3e2b29cfb12e11daf"} Sep 18 02:59:20.620597 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:20.618112 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gzvgz" podStartSLOduration=1.246516465 podStartE2EDuration="2.618094089s" totalImagesPullingTime="1.371577624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:20.616034722 +0000 UTC m=+79.658358112" watchObservedRunningTime="2026-09-18 02:59:20.618094089 +0000 UTC m=+79.660417498" Sep 18 02:59:20.735102 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:20.735062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:21.876089 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:21.876049 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:21.974640 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:21.974597 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:22.047577 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.047515 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:22.583184 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.583143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:22.691310 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.691279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:22.841852 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.841771 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:22.856681 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.856649 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486"] Sep 18 02:59:22.860318 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.860296 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:22.864954 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.864930 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 18 02:59:22.865085 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.865065 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 18 02:59:22.865166 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.865083 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-84rck\"" Sep 18 02:59:22.878997 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.878974 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486"] Sep 18 02:59:22.903138 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.903114 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ftqxt"] Sep 18 02:59:22.906185 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.906165 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.909748 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.909724 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 18 02:59:22.909856 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.909755 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 18 02:59:22.909856 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.909770 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d8pdc\"" Sep 18 02:59:22.910100 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.910084 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 18 02:59:22.957678 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.957651 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:22.977559 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977535 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-textfile\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.977659 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.977659 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-tls\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.977747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvtzb\" (UniqueName: \"kubernetes.io/projected/c8355db7-5a86-4421-a800-0ecb6569550e-kube-api-access-wvtzb\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.977747 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:22.977829 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977748 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.977876 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977813 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt7ld\" (UniqueName: \"kubernetes.io/projected/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-kube-api-access-kt7ld\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:22.977876 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:22.977978 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977882 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:22.977978 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8355db7-5a86-4421-a800-0ecb6569550e-metrics-client-ca\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.977978 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-wtmp\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.977978 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-root\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:22.978138 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:22.977998 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-sys\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.048953 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.048927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:23.078554 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.078526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvtzb\" (UniqueName: \"kubernetes.io/projected/c8355db7-5a86-4421-a800-0ecb6569550e-kube-api-access-wvtzb\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.078667 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.078562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.078667 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.078593 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.078667 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.078625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt7ld\" (UniqueName: \"kubernetes.io/projected/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-kube-api-access-kt7ld\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.078667 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.078654 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.078859 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.078679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.078859 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:23.078770 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 18 02:59:23.078859 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:23.078832 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-tls podName:10c683f6-c1ca-42a0-ace0-934b53cc0bfa nodeName:}" failed. No retries permitted until 2026-09-18 02:59:23.578812992 +0000 UTC m=+82.621136382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-8d486" (UID: "10c683f6-c1ca-42a0-ace0-934b53cc0bfa") : secret "openshift-state-metrics-tls" not found Sep 18 02:59:23.079063 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8355db7-5a86-4421-a800-0ecb6569550e-metrics-client-ca\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079182 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-wtmp\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079182 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-root\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079182 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-sys\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079343 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-textfile\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079343 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079209 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079343 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079218 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-accelerators-collector-config\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079343 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-wtmp\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079343 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-tls\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079343 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079264 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-sys\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079343 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079296 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c8355db7-5a86-4421-a800-0ecb6569550e-root\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079343 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079323 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.079764 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-textfile\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.079764 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.079540 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8355db7-5a86-4421-a800-0ecb6569550e-metrics-client-ca\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.081765 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.081739 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.082012 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.081992 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.082072 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.082015 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c8355db7-5a86-4421-a800-0ecb6569550e-node-exporter-tls\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.087648 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.087626 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt7ld\" (UniqueName: \"kubernetes.io/projected/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-kube-api-access-kt7ld\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.087772 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.087738 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvtzb\" (UniqueName: \"kubernetes.io/projected/c8355db7-5a86-4421-a800-0ecb6569550e-kube-api-access-wvtzb\") pod \"node-exporter-ftqxt\" (UID: \"c8355db7-5a86-4421-a800-0ecb6569550e\") " pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.150043 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.149978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:23.216512 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.216462 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ftqxt" Sep 18 02:59:23.230045 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:23.230019 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8355db7_5a86_4421_a800_0ecb6569550e.slice/crio-0857b8d9a3bdfa640a5cea0c06050489ca3e02a59287cb4ccbcf1e681121354b WatchSource:0}: Error finding container 0857b8d9a3bdfa640a5cea0c06050489ca3e02a59287cb4ccbcf1e681121354b: Status 404 returned error can't find the container with id 0857b8d9a3bdfa640a5cea0c06050489ca3e02a59287cb4ccbcf1e681121354b Sep 18 02:59:23.248965 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.248938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:23.348797 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.348751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:23.451273 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.451179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:23.587291 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.587259 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.590043 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.590013 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10c683f6-c1ca-42a0-ace0-934b53cc0bfa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8d486\" (UID: \"10c683f6-c1ca-42a0-ace0-934b53cc0bfa\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.609188 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.609087 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ftqxt" event={"ID":"c8355db7-5a86-4421-a800-0ecb6569550e","Type":"ContainerStarted","Data":"0857b8d9a3bdfa640a5cea0c06050489ca3e02a59287cb4ccbcf1e681121354b"} Sep 18 02:59:23.772043 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.771892 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" Sep 18 02:59:23.850967 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.850915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:23.952255 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.952223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:23.967713 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.967685 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 02:59:23.971999 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.971972 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:23.976261 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.976242 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 18 02:59:23.976801 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.976782 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 18 02:59:23.978289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.977121 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vfcbh\"" Sep 18 02:59:23.978289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.977197 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 18 02:59:23.978289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.977238 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 18 02:59:23.978289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.977277 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 18 02:59:23.978289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.977351 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 18 02:59:23.978289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.977388 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 18 02:59:23.978289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.977496 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 18 02:59:23.978813 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.978790 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 18 02:59:23.989755 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:23.989733 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 02:59:24.064540 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.064424 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486"] Sep 18 02:59:24.092153 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092289 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr5zq\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-kube-api-access-gr5zq\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092526 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092294 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-out\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092526 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092526 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092526 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092350 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-web-config\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092526 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092526 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092515 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092822 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.092822 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.092583 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193460 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.193402 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr5zq\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-kube-api-access-gr5zq\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193606 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.193509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-out\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193606 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.193541 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193606 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.193567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193606 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.193590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-web-config\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193815 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.193616 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193815 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.193645 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193815 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.193685 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.193959 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:24.193931 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 18 02:59:24.194209 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:24.194012 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls podName:e9dde7e7-7a43-4b44-82db-bf5853294e91 nodeName:}" failed. No retries permitted until 2026-09-18 02:59:24.693991302 +0000 UTC m=+83.736314702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91") : secret "alertmanager-main-tls" not found Sep 18 02:59:24.194335 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:24.194314 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle podName:e9dde7e7-7a43-4b44-82db-bf5853294e91 nodeName:}" failed. No retries permitted until 2026-09-18 02:59:24.694286263 +0000 UTC m=+83.736609666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91") : configmap references non-existent config key: ca-bundle.crt Sep 18 02:59:24.195611 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.194701 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.195611 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.194754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.195611 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.194785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.195611 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.194833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.195611 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.194866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.195611 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.195214 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.196195 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.196167 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-out\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.196934 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.196909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.197585 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.197542 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-web-config\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.198263 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.198240 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.198519 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.198471 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-volume\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.198621 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.198599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.198698 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.198659 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.198807 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.198779 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.199939 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.199913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.203774 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:24.203744 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c683f6_c1ca_42a0_ace0_934b53cc0bfa.slice/crio-939704e480b4f35ebec562ef71b6d33db05eb0a18aeebef7be42f8444971d322 WatchSource:0}: Error finding container 939704e480b4f35ebec562ef71b6d33db05eb0a18aeebef7be42f8444971d322: Status 404 returned error can't find the container with id 939704e480b4f35ebec562ef71b6d33db05eb0a18aeebef7be42f8444971d322 Sep 18 02:59:24.204044 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.204018 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr5zq\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-kube-api-access-gr5zq\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.615655 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.615574 2575 generic.go:356] "Generic (PLEG): container finished" podID="c8355db7-5a86-4421-a800-0ecb6569550e" containerID="ce722a1eadf8b2b9adb9a82d4ca10801bb8008657f85bfad9a755e67a63d08b9" exitCode=0 Sep 18 02:59:24.615810 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.615672 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ftqxt" event={"ID":"c8355db7-5a86-4421-a800-0ecb6569550e","Type":"ContainerDied","Data":"ce722a1eadf8b2b9adb9a82d4ca10801bb8008657f85bfad9a755e67a63d08b9"} Sep 18 02:59:24.617987 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.617962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" event={"ID":"10c683f6-c1ca-42a0-ace0-934b53cc0bfa","Type":"ContainerStarted","Data":"2da101770418e05d8205d8f3a7fe8801cf9e4423db27f191529ee53ec563f4d0"} Sep 18 02:59:24.618097 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.618020 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" event={"ID":"10c683f6-c1ca-42a0-ace0-934b53cc0bfa","Type":"ContainerStarted","Data":"cac0bfc20ef1229043ac985ebc35f3080011be4eee44959c3e3eb6c9b143e195"} Sep 18 02:59:24.618097 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.618051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" event={"ID":"10c683f6-c1ca-42a0-ace0-934b53cc0bfa","Type":"ContainerStarted","Data":"939704e480b4f35ebec562ef71b6d33db05eb0a18aeebef7be42f8444971d322"} Sep 18 02:59:24.698658 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.698628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.698767 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.698674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:24.699163 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:24.699141 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 18 02:59:24.699245 ip-10-0-134-53 kubenswrapper[2575]: E0918 02:59:24.699201 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls podName:e9dde7e7-7a43-4b44-82db-bf5853294e91 nodeName:}" failed. No retries permitted until 2026-09-18 02:59:25.69918233 +0000 UTC m=+84.741505726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91") : secret "alertmanager-main-tls" not found Sep 18 02:59:24.699583 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:24.699558 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:25.328453 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.328398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:25.628999 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.628928 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ftqxt" event={"ID":"c8355db7-5a86-4421-a800-0ecb6569550e","Type":"ContainerStarted","Data":"6a41d2fa98d85a746ad996b8e7f090c8385bb6b258cc1067a16d286e3170f2f1"} Sep 18 02:59:25.629173 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.629095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ftqxt" event={"ID":"c8355db7-5a86-4421-a800-0ecb6569550e","Type":"ContainerStarted","Data":"bdc1f00e3ca3ecd6181f9677694f4fc95d00428c31f29654818fdd2fccfd5dc3"} Sep 18 02:59:25.631275 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.631248 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" event={"ID":"10c683f6-c1ca-42a0-ace0-934b53cc0bfa","Type":"ContainerStarted","Data":"2478ba01734102f2c0f9cece6198364da3e69063a33136e60c82d61cd80c3692"} Sep 18 02:59:25.659801 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.659758 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ftqxt" podStartSLOduration=2.572160266 podStartE2EDuration="3.659740631s" totalImagesPullingTime="1.018903706s" totalInitContainerRuntime="68.676659ms" isStatefulPod=true podCreationTimestamp="2026-09-18 02:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:25.657946232 +0000 UTC m=+84.700269665" watchObservedRunningTime="2026-09-18 02:59:25.659740631 +0000 UTC m=+84.702064042" Sep 18 02:59:25.683183 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.683104 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8d486" podStartSLOduration=2.6041216130000002 podStartE2EDuration="3.683086847s" totalImagesPullingTime="1.078965234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:25.682283276 +0000 UTC m=+84.724606686" watchObservedRunningTime="2026-09-18 02:59:25.683086847 +0000 UTC m=+84.725410289" Sep 18 02:59:25.709053 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.708810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:25.711316 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.711295 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:25.785050 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.785021 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 02:59:25.903450 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.903400 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5ff9dbb459-bntsn"] Sep 18 02:59:25.908294 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.908271 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:25.912035 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.911870 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 18 02:59:25.912144 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.912121 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 18 02:59:25.913076 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.912825 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 18 02:59:25.913076 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.912882 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 18 02:59:25.913076 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.912926 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-coree44gaoghh\"" Sep 18 02:59:25.913076 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.912978 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5vq7k\"" Sep 18 02:59:25.913076 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.913039 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 18 02:59:25.924379 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.924360 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5ff9dbb459-bntsn"] Sep 18 02:59:25.967213 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:25.967141 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:26.010155 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.010130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.010291 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.010168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.010291 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.010211 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.010291 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.010230 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gb6c\" (UniqueName: \"kubernetes.io/projected/4c269926-4464-464b-8e86-b99439af5710-kube-api-access-2gb6c\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.010467 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.010293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.010467 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.010373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-grpc-tls\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.010467 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.010404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-tls\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.010467 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.010461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c269926-4464-464b-8e86-b99439af5710-metrics-client-ca\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.036327 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.036269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:26.076652 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.076628 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 02:59:26.080143 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:26.080121 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9dde7e7_7a43_4b44_82db_bf5853294e91.slice/crio-24dae3faba8eca4c844249a744cb79cef6540cbeed89a8e2eb7830ba27bbca23 WatchSource:0}: Error finding container 24dae3faba8eca4c844249a744cb79cef6540cbeed89a8e2eb7830ba27bbca23: Status 404 returned error can't find the container with id 24dae3faba8eca4c844249a744cb79cef6540cbeed89a8e2eb7830ba27bbca23 Sep 18 02:59:26.111293 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.111264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.111398 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.111304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gb6c\" (UniqueName: \"kubernetes.io/projected/4c269926-4464-464b-8e86-b99439af5710-kube-api-access-2gb6c\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.111398 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.111334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.111398 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.111366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-grpc-tls\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.111398 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.111393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-tls\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.111593 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.111431 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c269926-4464-464b-8e86-b99439af5710-metrics-client-ca\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.111593 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.111500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.111593 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.111531 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.112282 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.112256 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c269926-4464-464b-8e86-b99439af5710-metrics-client-ca\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.114514 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.114474 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-tls\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.114602 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.114571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.114804 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.114783 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.115218 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.115178 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.115320 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.115278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-grpc-tls\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.115320 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.115300 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c269926-4464-464b-8e86-b99439af5710-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.120605 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.120583 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gb6c\" (UniqueName: \"kubernetes.io/projected/4c269926-4464-464b-8e86-b99439af5710-kube-api-access-2gb6c\") pod \"thanos-querier-5ff9dbb459-bntsn\" (UID: \"4c269926-4464-464b-8e86-b99439af5710\") " pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.137170 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.137143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:26.221062 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.220973 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:26.372664 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.372617 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:26.522460 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.522385 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5ff9dbb459-bntsn"] Sep 18 02:59:26.527397 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:26.527369 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c269926_4464_464b_8e86_b99439af5710.slice/crio-c1d25f44de3ee93e9e3b613499390edc650974a6daba2c6d367ced240590a4e7 WatchSource:0}: Error finding container c1d25f44de3ee93e9e3b613499390edc650974a6daba2c6d367ced240590a4e7: Status 404 returned error can't find the container with id c1d25f44de3ee93e9e3b613499390edc650974a6daba2c6d367ced240590a4e7 Sep 18 02:59:26.584432 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.584337 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cm76t" Sep 18 02:59:26.638066 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.637968 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerStarted","Data":"24dae3faba8eca4c844249a744cb79cef6540cbeed89a8e2eb7830ba27bbca23"} Sep 18 02:59:26.640341 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:26.639727 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" event={"ID":"4c269926-4464-464b-8e86-b99439af5710","Type":"ContainerStarted","Data":"c1d25f44de3ee93e9e3b613499390edc650974a6daba2c6d367ced240590a4e7"} Sep 18 02:59:27.049329 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.049294 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75567bcf7c-vlc7w"] Sep 18 02:59:27.052520 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.052499 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.056354 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.056332 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p2cvk\"" Sep 18 02:59:27.056354 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.056346 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 18 02:59:27.056529 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.056513 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 18 02:59:27.056568 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.056546 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 18 02:59:27.056624 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.056346 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 18 02:59:27.056743 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.056727 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 18 02:59:27.067480 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.067424 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75567bcf7c-vlc7w"] Sep 18 02:59:27.122987 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.122943 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-console-config\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.123145 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.123000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-service-ca\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.123145 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.123072 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-oauth-serving-cert\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.123145 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.123102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48rt8\" (UniqueName: \"kubernetes.io/projected/563dd285-5e0d-47b3-85be-d91be717ef1e-kube-api-access-48rt8\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.123145 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.123128 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-oauth-config\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.123346 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.123173 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-serving-cert\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.123941 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.123911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:27.188104 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.188068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:27.224359 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.224327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-console-config\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.224518 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.224369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-service-ca\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.224518 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.224442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-oauth-serving-cert\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.224518 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.224473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48rt8\" (UniqueName: \"kubernetes.io/projected/563dd285-5e0d-47b3-85be-d91be717ef1e-kube-api-access-48rt8\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.224518 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.224501 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-oauth-config\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.224813 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.224537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-serving-cert\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.225148 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.225098 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-console-config\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.225370 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.225345 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-oauth-serving-cert\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.225510 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.225398 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-service-ca\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.227676 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.227633 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-oauth-config\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.227785 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.227763 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-serving-cert\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.234315 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.234283 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48rt8\" (UniqueName: \"kubernetes.io/projected/563dd285-5e0d-47b3-85be-d91be717ef1e-kube-api-access-48rt8\") pod \"console-75567bcf7c-vlc7w\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.363334 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.363300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:27.648879 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.648794 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:27.718070 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.718036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:27.794604 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:27.794558 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:29.350710 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.350581 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:29.351449 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.351422 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 02:59:29.356132 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.356006 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.358917 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.358890 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 02:59:29.362612 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.362398 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 02:59:29.362612 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.362486 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 02:59:29.362612 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.362518 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 02:59:29.362612 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.362526 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 02:59:29.363251 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.363233 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 02:59:29.363351 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.363242 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 02:59:29.363483 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.363467 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 02:59:29.363651 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.363632 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 02:59:29.363728 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.363691 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 02:59:29.363839 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.363821 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 02:59:29.364072 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.364042 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 02:59:29.365347 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.365289 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 02:59:29.365542 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.365524 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-452zc\"" Sep 18 02:59:29.366000 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.365877 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2oihb40ijc9ic\"" Sep 18 02:59:29.366958 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.366935 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 02:59:29.371061 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.371040 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 02:59:29.380020 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.379993 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.447700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.447742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.447770 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.447796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.447835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64glm\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-kube-api-access-64glm\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.447872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-config-out\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.447899 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.447940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448012 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-web-config\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448107 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-config\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.448638 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.448401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.548854 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.548819 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549053 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.548864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549053 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.548891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549053 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.548921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-config\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549053 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.548949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549053 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.548978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549053 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549053 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549153 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64glm\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-kube-api-access-64glm\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-config-out\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-web-config\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.549440 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549424 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.550032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.550032 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.549855 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.550132 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.550052 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.550132 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.550076 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.550496 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.550354 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.551457 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.551385 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.553509 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.553484 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.554476 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.553873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.555528 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.555429 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-config\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.555775 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.555753 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.556824 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.556785 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.557531 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.557490 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.557854 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.557822 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-config-out\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.558173 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.558147 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.558329 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.558311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-web-config\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.558544 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.558507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.558998 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.558955 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.559175 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.559149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.559536 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.559517 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.563699 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.563678 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64glm\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-kube-api-access-64glm\") pod \"prometheus-k8s-0\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:29.670004 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:29.669936 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:30.541229 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:30.541198 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5964f9b69b-nljrv" Sep 18 02:59:30.718671 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:30.718636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:30.822602 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:30.822565 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:30.920984 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:30.920926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:31.571215 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:31.571182 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:31.672087 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:31.672048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:32.541120 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:32.541082 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:32.619734 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:32.619703 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:34.266234 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:34.266195 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:34.347659 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:34.347624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:35.573164 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.573140 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75567bcf7c-vlc7w"] Sep 18 02:59:35.575190 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:35.575163 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod563dd285_5e0d_47b3_85be_d91be717ef1e.slice/crio-cda3cf42736aab45ca279a4667210cfd08ef8ccac794b6f3ca4c5812eca1aab5 WatchSource:0}: Error finding container cda3cf42736aab45ca279a4667210cfd08ef8ccac794b6f3ca4c5812eca1aab5: Status 404 returned error can't find the container with id cda3cf42736aab45ca279a4667210cfd08ef8ccac794b6f3ca4c5812eca1aab5 Sep 18 02:59:35.581934 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.581907 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 02:59:35.584348 ip-10-0-134-53 kubenswrapper[2575]: W0918 02:59:35.584325 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884a0685_f5ff_4394_b383_94afb8ec9a81.slice/crio-a91670fbb8b0b6a71eae1a32dcea19ed463dd47b93978c0d1ebc189784159eaa WatchSource:0}: Error finding container a91670fbb8b0b6a71eae1a32dcea19ed463dd47b93978c0d1ebc189784159eaa: Status 404 returned error can't find the container with id a91670fbb8b0b6a71eae1a32dcea19ed463dd47b93978c0d1ebc189784159eaa Sep 18 02:59:35.680184 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.680147 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75567bcf7c-vlc7w" event={"ID":"563dd285-5e0d-47b3-85be-d91be717ef1e","Type":"ContainerStarted","Data":"cda3cf42736aab45ca279a4667210cfd08ef8ccac794b6f3ca4c5812eca1aab5"} Sep 18 02:59:35.682049 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.682019 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerStarted","Data":"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31"} Sep 18 02:59:35.682143 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.682091 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerStarted","Data":"a91670fbb8b0b6a71eae1a32dcea19ed463dd47b93978c0d1ebc189784159eaa"} Sep 18 02:59:35.684681 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.684561 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerID="5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7" exitCode=0 Sep 18 02:59:35.684986 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.684962 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerDied","Data":"5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7"} Sep 18 02:59:35.686761 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.686726 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" event={"ID":"4c269926-4464-464b-8e86-b99439af5710","Type":"ContainerStarted","Data":"f237789ab60a0b37f5ba23fc61b92b5d4499c36e8b490a1f5724449c7fa98c62"} Sep 18 02:59:35.688729 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.688704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-p7gx9" event={"ID":"507ca8a3-229b-414c-891f-facc065ad04b","Type":"ContainerStarted","Data":"2321712aca5b4dc34b2c38e394e5a11d796685d11cb86c34adcf1dd5802110ce"} Sep 18 02:59:35.700204 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.700065 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-p7gx9" Sep 18 02:59:35.701673 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.701647 2575 patch_prober.go:28] interesting pod/downloads-6594f4c75-p7gx9 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body= Sep 18 02:59:35.701770 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.701700 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6594f4c75-p7gx9" podUID="507ca8a3-229b-414c-891f-facc065ad04b" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" Sep 18 02:59:35.735936 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:35.735884 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-p7gx9" podStartSLOduration=1.2629425429999999 podStartE2EDuration="18.735867267s" totalImagesPullingTime="17.472924724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:35.734726747 +0000 UTC m=+94.777050177" watchObservedRunningTime="2026-09-18 02:59:35.735867267 +0000 UTC m=+94.778190693" Sep 18 02:59:36.706465 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:36.701627 2575 generic.go:356] "Generic (PLEG): container finished" podID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" exitCode=0 Sep 18 02:59:36.706465 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:36.701755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerDied","Data":"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31"} Sep 18 02:59:36.708785 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:36.708631 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" event={"ID":"4c269926-4464-464b-8e86-b99439af5710","Type":"ContainerStarted","Data":"2e1c5b84bc9efb955fbbfeccba282fba1ff90b98cd4f861df3c7a2e854a2b96e"} Sep 18 02:59:36.708785 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:36.708712 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" event={"ID":"4c269926-4464-464b-8e86-b99439af5710","Type":"ContainerStarted","Data":"eed926454bb71da71bf8aef92693a7792d6fc55190d2d0d88438d768716af434"} Sep 18 02:59:36.729114 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:36.729070 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-p7gx9" Sep 18 02:59:36.964519 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:36.964400 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:37.061470 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:37.061436 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:37.186625 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:37.186570 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:37.284183 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:37.283934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:40.628789 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:40.628690 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:40.730547 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:40.730488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:43.435402 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:43.435353 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:43.515571 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:43.515433 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:44.752360 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.752325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75567bcf7c-vlc7w" event={"ID":"563dd285-5e0d-47b3-85be-d91be717ef1e","Type":"ContainerStarted","Data":"2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111"} Sep 18 02:59:44.755633 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.755601 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerStarted","Data":"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98"} Sep 18 02:59:44.755738 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.755673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerStarted","Data":"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992"} Sep 18 02:59:44.755738 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.755717 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerStarted","Data":"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202"} Sep 18 02:59:44.755813 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.755744 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerStarted","Data":"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c"} Sep 18 02:59:44.755813 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.755766 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerStarted","Data":"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c"} Sep 18 02:59:44.755813 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.755800 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerStarted","Data":"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae"} Sep 18 02:59:44.758931 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.758905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerStarted","Data":"5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0"} Sep 18 02:59:44.759037 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.758972 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerStarted","Data":"272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8"} Sep 18 02:59:44.759037 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.759014 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerStarted","Data":"1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab"} Sep 18 02:59:44.759122 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.759039 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerStarted","Data":"2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c"} Sep 18 02:59:44.759122 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.759068 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerStarted","Data":"dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3"} Sep 18 02:59:44.759122 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.759097 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerStarted","Data":"97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c"} Sep 18 02:59:44.761584 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.761560 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" event={"ID":"4c269926-4464-464b-8e86-b99439af5710","Type":"ContainerStarted","Data":"e5a1146759997fdcd4c05f3278adbfb180744e10da5588423cff357247d21a94"} Sep 18 02:59:44.761660 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.761622 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" event={"ID":"4c269926-4464-464b-8e86-b99439af5710","Type":"ContainerStarted","Data":"8f2a35a9c5f8fd38ac2432ea380f0dcc965f7addbd6cd0d036ebabfff7add992"} Sep 18 02:59:44.761699 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.761671 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:44.761731 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.761709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" event={"ID":"4c269926-4464-464b-8e86-b99439af5710","Type":"ContainerStarted","Data":"09930aefa1630477651c9d2c0b916da4d55ab4d4cf1ac9be85375034b81a28c0"} Sep 18 02:59:44.767027 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.767011 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" Sep 18 02:59:44.806489 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.806441 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75567bcf7c-vlc7w" podStartSLOduration=9.398307362 podStartE2EDuration="17.806397084s" totalImagesPullingTime="8.408089722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:44.773817797 +0000 UTC m=+103.816141205" watchObservedRunningTime="2026-09-18 02:59:44.806397084 +0000 UTC m=+103.848720490" Sep 18 02:59:44.807209 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.807175 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.307328004 podStartE2EDuration="21.807164181s" totalImagesPullingTime="17.484331585s" totalInitContainerRuntime="15.504592ms" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:44.803563827 +0000 UTC m=+103.845887233" watchObservedRunningTime="2026-09-18 02:59:44.807164181 +0000 UTC m=+103.849487606" Sep 18 02:59:44.864092 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.864000 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5ff9dbb459-bntsn" podStartSLOduration=4.265931591 podStartE2EDuration="19.863980319s" totalImagesPullingTime="15.598048728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:44.861349307 +0000 UTC m=+103.903672739" watchObservedRunningTime="2026-09-18 02:59:44.863980319 +0000 UTC m=+103.906303727" Sep 18 02:59:44.914080 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.914025 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.576432909 podStartE2EDuration="15.914005924s" totalImagesPullingTime="7.310300697s" totalInitContainerRuntime="27.272318ms" isStatefulPod=false podCreationTimestamp="2026-09-18 02:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 02:59:44.912212211 +0000 UTC m=+103.954535618" watchObservedRunningTime="2026-09-18 02:59:44.914005924 +0000 UTC m=+103.956329334" Sep 18 02:59:44.961543 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:44.961514 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:45.035230 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:45.035181 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:46.375840 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:46.375805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:46.469678 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:46.469645 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:47.363475 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:47.363432 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:47.363682 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:47.363499 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:47.367897 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:47.367872 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:47.584193 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:47.584170 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h6fj8" Sep 18 02:59:47.672248 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:47.672174 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75567bcf7c-vlc7w"] Sep 18 02:59:47.776565 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:47.776540 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 02:59:48.944524 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:48.944495 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:49.027362 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:49.027316 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:49.350150 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:49.350122 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:49.423928 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:49.423900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:49.670381 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:49.670316 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 02:59:50.911355 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:50.911316 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:50.980608 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:50.980585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 02:59:59.963323 ip-10-0-134-53 kubenswrapper[2575]: I0918 02:59:59.963266 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:00.040225 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:00.040193 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:13.795102 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:13.795040 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75567bcf7c-vlc7w" podUID="563dd285-5e0d-47b3-85be-d91be717ef1e" containerName="console" containerID="cri-o://2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111" gracePeriod=15 Sep 18 03:00:14.082722 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.082693 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 03:00:14.118299 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118272 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-oauth-serving-cert\") pod \"563dd285-5e0d-47b3-85be-d91be717ef1e\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " Sep 18 03:00:14.118473 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118321 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-console-config\") pod \"563dd285-5e0d-47b3-85be-d91be717ef1e\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " Sep 18 03:00:14.118473 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118344 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-oauth-config\") pod \"563dd285-5e0d-47b3-85be-d91be717ef1e\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " Sep 18 03:00:14.118473 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118379 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-service-ca\") pod \"563dd285-5e0d-47b3-85be-d91be717ef1e\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " Sep 18 03:00:14.118473 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118446 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48rt8\" (UniqueName: \"kubernetes.io/projected/563dd285-5e0d-47b3-85be-d91be717ef1e-kube-api-access-48rt8\") pod \"563dd285-5e0d-47b3-85be-d91be717ef1e\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " Sep 18 03:00:14.118665 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118479 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-serving-cert\") pod \"563dd285-5e0d-47b3-85be-d91be717ef1e\" (UID: \"563dd285-5e0d-47b3-85be-d91be717ef1e\") " Sep 18 03:00:14.118770 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118742 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "563dd285-5e0d-47b3-85be-d91be717ef1e" (UID: "563dd285-5e0d-47b3-85be-d91be717ef1e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:14.118851 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118749 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-service-ca" (OuterVolumeSpecName: "service-ca") pod "563dd285-5e0d-47b3-85be-d91be717ef1e" (UID: "563dd285-5e0d-47b3-85be-d91be717ef1e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:14.118851 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.118780 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-console-config" (OuterVolumeSpecName: "console-config") pod "563dd285-5e0d-47b3-85be-d91be717ef1e" (UID: "563dd285-5e0d-47b3-85be-d91be717ef1e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:14.120741 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.120713 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "563dd285-5e0d-47b3-85be-d91be717ef1e" (UID: "563dd285-5e0d-47b3-85be-d91be717ef1e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:14.120979 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.120953 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563dd285-5e0d-47b3-85be-d91be717ef1e-kube-api-access-48rt8" (OuterVolumeSpecName: "kube-api-access-48rt8") pod "563dd285-5e0d-47b3-85be-d91be717ef1e" (UID: "563dd285-5e0d-47b3-85be-d91be717ef1e"). InnerVolumeSpecName "kube-api-access-48rt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:00:14.121073 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.121019 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "563dd285-5e0d-47b3-85be-d91be717ef1e" (UID: "563dd285-5e0d-47b3-85be-d91be717ef1e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:14.219334 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.219310 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-oauth-serving-cert\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:14.219334 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.219331 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-console-config\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:14.219504 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.219343 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-oauth-config\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:14.219504 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.219352 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/563dd285-5e0d-47b3-85be-d91be717ef1e-service-ca\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:14.219504 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.219360 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48rt8\" (UniqueName: \"kubernetes.io/projected/563dd285-5e0d-47b3-85be-d91be717ef1e-kube-api-access-48rt8\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:14.219504 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.219368 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/563dd285-5e0d-47b3-85be-d91be717ef1e-console-serving-cert\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:14.883386 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.883351 2575 generic.go:356] "Generic (PLEG): container finished" podID="563dd285-5e0d-47b3-85be-d91be717ef1e" containerID="2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111" exitCode=0 Sep 18 03:00:14.883854 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.883429 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75567bcf7c-vlc7w" Sep 18 03:00:14.883854 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.883437 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75567bcf7c-vlc7w" event={"ID":"563dd285-5e0d-47b3-85be-d91be717ef1e","Type":"ContainerDied","Data":"2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111"} Sep 18 03:00:14.883854 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.883521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75567bcf7c-vlc7w" event={"ID":"563dd285-5e0d-47b3-85be-d91be717ef1e","Type":"ContainerDied","Data":"cda3cf42736aab45ca279a4667210cfd08ef8ccac794b6f3ca4c5812eca1aab5"} Sep 18 03:00:14.883854 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.883543 2575 scope.go:117] "RemoveContainer" containerID="2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111" Sep 18 03:00:14.893930 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.893874 2575 scope.go:117] "RemoveContainer" containerID="2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111" Sep 18 03:00:14.894461 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:14.894439 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111\": container with ID starting with 2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111 not found: ID does not exist" containerID="2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111" Sep 18 03:00:14.894553 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.894468 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111"} err="failed to get container status \"2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111\": rpc error: code = NotFound desc = could not find container \"2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111\": container with ID starting with 2f52cf19a733bf2e99da6359a921d219081358819a0c25c74603d9ebbe162111 not found: ID does not exist" Sep 18 03:00:14.908029 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.908010 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75567bcf7c-vlc7w"] Sep 18 03:00:14.913813 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:14.913794 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75567bcf7c-vlc7w"] Sep 18 03:00:15.214361 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:15.214285 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="563dd285-5e0d-47b3-85be-d91be717ef1e" path="/var/lib/kubelet/pods/563dd285-5e0d-47b3-85be-d91be717ef1e/volumes" Sep 18 03:00:29.671117 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:29.671079 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:29.690257 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:29.690224 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:29.967003 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:29.966933 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:39.164068 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:39.164028 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:39.272966 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:39.272932 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:39.723322 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:39.723292 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:39.832915 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:39.832874 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:40.353170 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:40.353143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:40.455764 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:40.455739 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:43.477658 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:43.477626 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:00:43.478030 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:43.477878 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="alertmanager" containerID="cri-o://97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c" gracePeriod=120 Sep 18 03:00:43.478030 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:43.477945 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy-metric" containerID="cri-o://272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8" gracePeriod=120 Sep 18 03:00:43.478030 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:43.477996 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy" containerID="cri-o://1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab" gracePeriod=120 Sep 18 03:00:43.478211 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:43.478002 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="config-reloader" containerID="cri-o://dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3" gracePeriod=120 Sep 18 03:00:43.478211 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:43.478042 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="prom-label-proxy" containerID="cri-o://5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0" gracePeriod=120 Sep 18 03:00:43.478211 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:43.477973 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy-web" containerID="cri-o://2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c" gracePeriod=120 Sep 18 03:00:44.010922 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.010886 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerID="5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0" exitCode=0 Sep 18 03:00:44.010922 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.010912 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerID="272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8" exitCode=0 Sep 18 03:00:44.010922 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.010920 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerID="1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab" exitCode=0 Sep 18 03:00:44.010922 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.010927 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerID="dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3" exitCode=0 Sep 18 03:00:44.010922 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.010934 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerID="97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c" exitCode=0 Sep 18 03:00:44.011274 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.010954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerDied","Data":"5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0"} Sep 18 03:00:44.011274 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.011037 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerDied","Data":"272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8"} Sep 18 03:00:44.011274 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.011063 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerDied","Data":"1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab"} Sep 18 03:00:44.011274 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.011087 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerDied","Data":"dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3"} Sep 18 03:00:44.011274 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.011109 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerDied","Data":"97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c"} Sep 18 03:00:44.727400 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.727373 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:00:44.856232 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856154 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-web\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856232 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856190 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-web-config\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856463 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856249 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-metrics-client-ca\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856463 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856275 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr5zq\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-kube-api-access-gr5zq\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856463 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856313 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-tls-assets\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856463 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856342 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-main-db\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856463 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856369 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-out\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856463 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856441 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856748 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856466 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-volume\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856748 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856492 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856748 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856529 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856748 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856560 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.856748 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856594 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-cluster-tls-config\") pod \"e9dde7e7-7a43-4b44-82db-bf5853294e91\" (UID: \"e9dde7e7-7a43-4b44-82db-bf5853294e91\") " Sep 18 03:00:44.857033 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856765 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:44.857033 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856871 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-metrics-client-ca\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.857033 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.856765 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:00:44.858223 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.858179 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:44.859403 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.859365 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:00:44.859664 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.859640 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:44.859742 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.859684 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:44.860006 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.859978 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-out" (OuterVolumeSpecName: "config-out") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:00:44.860213 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.860181 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:44.860301 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.860264 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-kube-api-access-gr5zq" (OuterVolumeSpecName: "kube-api-access-gr5zq") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "kube-api-access-gr5zq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:00:44.860402 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.860378 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:44.860757 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.860741 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-volume" (OuterVolumeSpecName: "config-volume") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:44.863399 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.863287 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:44.869653 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.869635 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-web-config" (OuterVolumeSpecName: "web-config") pod "e9dde7e7-7a43-4b44-82db-bf5853294e91" (UID: "e9dde7e7-7a43-4b44-82db-bf5853294e91"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:44.958134 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958113 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr5zq\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-kube-api-access-gr5zq\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958134 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958133 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e9dde7e7-7a43-4b44-82db-bf5853294e91-tls-assets\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958144 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-main-db\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958151 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-out\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958160 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958168 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-config-volume\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958176 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958184 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9dde7e7-7a43-4b44-82db-bf5853294e91-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958192 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-main-tls\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958201 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-cluster-tls-config\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958209 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:44.958248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:44.958237 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e9dde7e7-7a43-4b44-82db-bf5853294e91-web-config\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:45.018031 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.018010 2575 generic.go:356] "Generic (PLEG): container finished" podID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerID="2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c" exitCode=0 Sep 18 03:00:45.018110 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.018057 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerDied","Data":"2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c"} Sep 18 03:00:45.018110 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.018088 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 18 03:00:45.018180 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.018117 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e9dde7e7-7a43-4b44-82db-bf5853294e91","Type":"ContainerDied","Data":"24dae3faba8eca4c844249a744cb79cef6540cbeed89a8e2eb7830ba27bbca23"} Sep 18 03:00:45.018180 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.018150 2575 scope.go:117] "RemoveContainer" containerID="5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0" Sep 18 03:00:45.025971 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.025954 2575 scope.go:117] "RemoveContainer" containerID="272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8" Sep 18 03:00:45.032315 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.032301 2575 scope.go:117] "RemoveContainer" containerID="1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab" Sep 18 03:00:45.038384 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.038359 2575 scope.go:117] "RemoveContainer" containerID="2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c" Sep 18 03:00:45.042155 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.042136 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:00:45.045467 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.045431 2575 scope.go:117] "RemoveContainer" containerID="dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3" Sep 18 03:00:45.046740 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.046723 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 18 03:00:45.052059 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.052045 2575 scope.go:117] "RemoveContainer" containerID="97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c" Sep 18 03:00:45.058481 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.058462 2575 scope.go:117] "RemoveContainer" containerID="5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7" Sep 18 03:00:45.064846 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.064832 2575 scope.go:117] "RemoveContainer" containerID="5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0" Sep 18 03:00:45.065085 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:45.065069 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0\": container with ID starting with 5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0 not found: ID does not exist" containerID="5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0" Sep 18 03:00:45.065135 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.065090 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0"} err="failed to get container status \"5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0\": rpc error: code = NotFound desc = could not find container \"5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0\": container with ID starting with 5a67252bb07f5e86822670407f66a89e9d24ec9320ac86c2ba1ffd0125f103c0 not found: ID does not exist" Sep 18 03:00:45.065135 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.065106 2575 scope.go:117] "RemoveContainer" containerID="272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8" Sep 18 03:00:45.065327 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:45.065312 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8\": container with ID starting with 272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8 not found: ID does not exist" containerID="272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8" Sep 18 03:00:45.065368 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.065331 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8"} err="failed to get container status \"272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8\": rpc error: code = NotFound desc = could not find container \"272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8\": container with ID starting with 272a702a28104a5aba92bba622796706d0e6e6a2062a4411dde43eb45207ffd8 not found: ID does not exist" Sep 18 03:00:45.065368 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.065344 2575 scope.go:117] "RemoveContainer" containerID="1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab" Sep 18 03:00:45.065583 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:45.065567 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab\": container with ID starting with 1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab not found: ID does not exist" containerID="1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab" Sep 18 03:00:45.065631 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.065585 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab"} err="failed to get container status \"1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab\": rpc error: code = NotFound desc = could not find container \"1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab\": container with ID starting with 1695c51b87c9176343b3d4cf95475c6f56e3e1d49ae8c751cd46835e7efea4ab not found: ID does not exist" Sep 18 03:00:45.065631 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.065599 2575 scope.go:117] "RemoveContainer" containerID="2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c" Sep 18 03:00:45.065798 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:45.065782 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c\": container with ID starting with 2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c not found: ID does not exist" containerID="2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c" Sep 18 03:00:45.065832 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.065800 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c"} err="failed to get container status \"2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c\": rpc error: code = NotFound desc = could not find container \"2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c\": container with ID starting with 2a55778b9d91248b631765bc29f6c8ce71ef73d2e85a0dd06eda5f8bb2f4815c not found: ID does not exist" Sep 18 03:00:45.065832 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.065811 2575 scope.go:117] "RemoveContainer" containerID="dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3" Sep 18 03:00:45.066030 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:45.066010 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3\": container with ID starting with dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3 not found: ID does not exist" containerID="dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3" Sep 18 03:00:45.066081 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.066035 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3"} err="failed to get container status \"dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3\": rpc error: code = NotFound desc = could not find container \"dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3\": container with ID starting with dd5947277683956c44dc2abf9347ff3ffc9070af2588f1e6b50fb9e0abc370f3 not found: ID does not exist" Sep 18 03:00:45.066081 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.066050 2575 scope.go:117] "RemoveContainer" containerID="97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c" Sep 18 03:00:45.066259 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:45.066245 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c\": container with ID starting with 97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c not found: ID does not exist" containerID="97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c" Sep 18 03:00:45.066296 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.066262 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c"} err="failed to get container status \"97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c\": rpc error: code = NotFound desc = could not find container \"97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c\": container with ID starting with 97b65099d0f42cae4e1050c0ffc5131c955fd1dc40a90f46e8ace2806f03844c not found: ID does not exist" Sep 18 03:00:45.066296 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.066273 2575 scope.go:117] "RemoveContainer" containerID="5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7" Sep 18 03:00:45.066532 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:45.066515 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7\": container with ID starting with 5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7 not found: ID does not exist" containerID="5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7" Sep 18 03:00:45.066621 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.066532 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7"} err="failed to get container status \"5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7\": rpc error: code = NotFound desc = could not find container \"5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7\": container with ID starting with 5284045d3a8d25436536b547f3822494378cb0d994b5481e89c2512c0834f8e7 not found: ID does not exist" Sep 18 03:00:45.212567 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:45.212507 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" path="/var/lib/kubelet/pods/e9dde7e7-7a43-4b44-82db-bf5853294e91/volumes" Sep 18 03:00:47.735232 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:47.735198 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:00:47.735767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:47.735525 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="prometheus" containerID="cri-o://fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" gracePeriod=600 Sep 18 03:00:47.735767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:47.735552 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy" containerID="cri-o://80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" gracePeriod=600 Sep 18 03:00:47.735767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:47.735575 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="thanos-sidecar" containerID="cri-o://5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" gracePeriod=600 Sep 18 03:00:47.735767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:47.735582 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy-web" containerID="cri-o://8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" gracePeriod=600 Sep 18 03:00:47.735767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:47.735638 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="config-reloader" containerID="cri-o://aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" gracePeriod=600 Sep 18 03:00:47.735767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:47.735676 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" gracePeriod=600 Sep 18 03:00:47.970862 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:47.970838 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.036747 2575 generic.go:356] "Generic (PLEG): container finished" podID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" exitCode=0 Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.036772 2575 generic.go:356] "Generic (PLEG): container finished" podID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" exitCode=0 Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.036781 2575 generic.go:356] "Generic (PLEG): container finished" podID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" exitCode=0 Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.036789 2575 generic.go:356] "Generic (PLEG): container finished" podID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" exitCode=0 Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.036797 2575 generic.go:356] "Generic (PLEG): container finished" podID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" exitCode=0 Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.036804 2575 generic.go:356] "Generic (PLEG): container finished" podID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" exitCode=0 Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.036880 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerDied","Data":"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98"} Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.036982 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerDied","Data":"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992"} Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.037022 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerDied","Data":"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202"} Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.037058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerDied","Data":"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c"} Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.037095 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerDied","Data":"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c"} Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.037132 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerDied","Data":"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae"} Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.037167 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"884a0685-f5ff-4394-b383-94afb8ec9a81","Type":"ContainerDied","Data":"a91670fbb8b0b6a71eae1a32dcea19ed463dd47b93978c0d1ebc189784159eaa"} Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.037211 2575 scope.go:117] "RemoveContainer" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" Sep 18 03:00:48.037681 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.037433 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.046162 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.046144 2575 scope.go:117] "RemoveContainer" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" Sep 18 03:00:48.053248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.053230 2575 scope.go:117] "RemoveContainer" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" Sep 18 03:00:48.060181 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.060166 2575 scope.go:117] "RemoveContainer" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" Sep 18 03:00:48.066485 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.066469 2575 scope.go:117] "RemoveContainer" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" Sep 18 03:00:48.072897 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.072881 2575 scope.go:117] "RemoveContainer" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" Sep 18 03:00:48.079666 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.079650 2575 scope.go:117] "RemoveContainer" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" Sep 18 03:00:48.081636 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081613 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-1\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.081765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081654 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-db\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.081765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081700 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-metrics-client-certs\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.081765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081726 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-tls-assets\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.081920 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081776 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-kube-rbac-proxy\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.081920 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081800 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-kubelet-serving-ca-bundle\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.081920 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081824 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-config\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.081920 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081870 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-2\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.081920 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081895 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-config-out\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082157 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081922 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-metrics-client-ca\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082157 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081939 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:48.082157 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.081948 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-thanos-prometheus-http-client-file\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082157 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082010 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-trusted-ca-bundle\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082157 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082080 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082157 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082127 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-tls\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082157 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082153 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-serving-certs-ca-bundle\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082574 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082183 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-web-config\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082574 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082227 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082574 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082254 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64glm\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-kube-api-access-64glm\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082574 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082280 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-0\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082574 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082302 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-grpc-tls\") pod \"884a0685-f5ff-4394-b383-94afb8ec9a81\" (UID: \"884a0685-f5ff-4394-b383-94afb8ec9a81\") " Sep 18 03:00:48.082791 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082589 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.082791 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082598 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:48.082993 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082900 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:48.083071 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.082980 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:00:48.083299 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.083271 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:48.083802 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.083774 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:48.084245 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.084050 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.084569 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.084357 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:48.085608 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.084760 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.085608 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.084951 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.085608 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.085568 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.086253 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.086225 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 18 03:00:48.087470 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.087444 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:00:48.087583 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.087487 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-kube-api-access-64glm" (OuterVolumeSpecName: "kube-api-access-64glm") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "kube-api-access-64glm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:00:48.087634 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.087615 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-config" (OuterVolumeSpecName: "config") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.087745 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.087724 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-config-out" (OuterVolumeSpecName: "config-out") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:00:48.087809 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.087791 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.087865 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.087847 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.088229 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.088210 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.088278 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.088229 2575 scope.go:117] "RemoveContainer" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" Sep 18 03:00:48.088631 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:48.088596 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": container with ID starting with a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98 not found: ID does not exist" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" Sep 18 03:00:48.088704 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.088626 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98"} err="failed to get container status \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": rpc error: code = NotFound desc = could not find container \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": container with ID starting with a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98 not found: ID does not exist" Sep 18 03:00:48.088704 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.088647 2575 scope.go:117] "RemoveContainer" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" Sep 18 03:00:48.088980 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:48.088951 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": container with ID starting with 80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992 not found: ID does not exist" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" Sep 18 03:00:48.089041 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.088985 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992"} err="failed to get container status \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": rpc error: code = NotFound desc = could not find container \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": container with ID starting with 80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992 not found: ID does not exist" Sep 18 03:00:48.089041 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.088999 2575 scope.go:117] "RemoveContainer" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" Sep 18 03:00:48.089277 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:48.089262 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": container with ID starting with 8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202 not found: ID does not exist" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" Sep 18 03:00:48.089339 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.089283 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202"} err="failed to get container status \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": rpc error: code = NotFound desc = could not find container \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": container with ID starting with 8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202 not found: ID does not exist" Sep 18 03:00:48.089339 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.089297 2575 scope.go:117] "RemoveContainer" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" Sep 18 03:00:48.089539 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:48.089523 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": container with ID starting with 5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c not found: ID does not exist" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" Sep 18 03:00:48.089579 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.089542 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c"} err="failed to get container status \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": rpc error: code = NotFound desc = could not find container \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": container with ID starting with 5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c not found: ID does not exist" Sep 18 03:00:48.089579 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.089554 2575 scope.go:117] "RemoveContainer" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" Sep 18 03:00:48.089806 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:48.089790 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": container with ID starting with aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c not found: ID does not exist" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" Sep 18 03:00:48.089854 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.089813 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c"} err="failed to get container status \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": rpc error: code = NotFound desc = could not find container \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": container with ID starting with aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c not found: ID does not exist" Sep 18 03:00:48.089854 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.089831 2575 scope.go:117] "RemoveContainer" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" Sep 18 03:00:48.090069 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:48.090055 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": container with ID starting with fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae not found: ID does not exist" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" Sep 18 03:00:48.090109 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.090072 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae"} err="failed to get container status \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": rpc error: code = NotFound desc = could not find container \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": container with ID starting with fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae not found: ID does not exist" Sep 18 03:00:48.090109 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.090085 2575 scope.go:117] "RemoveContainer" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" Sep 18 03:00:48.090328 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:00:48.090314 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": container with ID starting with 1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31 not found: ID does not exist" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" Sep 18 03:00:48.090370 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.090333 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31"} err="failed to get container status \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": rpc error: code = NotFound desc = could not find container \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": container with ID starting with 1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31 not found: ID does not exist" Sep 18 03:00:48.090370 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.090345 2575 scope.go:117] "RemoveContainer" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" Sep 18 03:00:48.090582 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.090567 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98"} err="failed to get container status \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": rpc error: code = NotFound desc = could not find container \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": container with ID starting with a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98 not found: ID does not exist" Sep 18 03:00:48.090624 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.090582 2575 scope.go:117] "RemoveContainer" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" Sep 18 03:00:48.090810 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.090796 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992"} err="failed to get container status \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": rpc error: code = NotFound desc = could not find container \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": container with ID starting with 80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992 not found: ID does not exist" Sep 18 03:00:48.090856 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.090811 2575 scope.go:117] "RemoveContainer" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" Sep 18 03:00:48.091056 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.091038 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202"} err="failed to get container status \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": rpc error: code = NotFound desc = could not find container \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": container with ID starting with 8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202 not found: ID does not exist" Sep 18 03:00:48.091056 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.091053 2575 scope.go:117] "RemoveContainer" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" Sep 18 03:00:48.091280 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.091265 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c"} err="failed to get container status \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": rpc error: code = NotFound desc = could not find container \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": container with ID starting with 5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c not found: ID does not exist" Sep 18 03:00:48.091280 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.091280 2575 scope.go:117] "RemoveContainer" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" Sep 18 03:00:48.091608 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.091590 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c"} err="failed to get container status \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": rpc error: code = NotFound desc = could not find container \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": container with ID starting with aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c not found: ID does not exist" Sep 18 03:00:48.091670 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.091609 2575 scope.go:117] "RemoveContainer" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" Sep 18 03:00:48.091854 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.091839 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae"} err="failed to get container status \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": rpc error: code = NotFound desc = could not find container \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": container with ID starting with fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae not found: ID does not exist" Sep 18 03:00:48.091896 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.091855 2575 scope.go:117] "RemoveContainer" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" Sep 18 03:00:48.092057 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092040 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31"} err="failed to get container status \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": rpc error: code = NotFound desc = could not find container \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": container with ID starting with 1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31 not found: ID does not exist" Sep 18 03:00:48.092057 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092054 2575 scope.go:117] "RemoveContainer" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" Sep 18 03:00:48.092260 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092243 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98"} err="failed to get container status \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": rpc error: code = NotFound desc = could not find container \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": container with ID starting with a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98 not found: ID does not exist" Sep 18 03:00:48.092316 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092260 2575 scope.go:117] "RemoveContainer" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" Sep 18 03:00:48.092456 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092439 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992"} err="failed to get container status \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": rpc error: code = NotFound desc = could not find container \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": container with ID starting with 80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992 not found: ID does not exist" Sep 18 03:00:48.092511 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092456 2575 scope.go:117] "RemoveContainer" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" Sep 18 03:00:48.092695 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092676 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202"} err="failed to get container status \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": rpc error: code = NotFound desc = could not find container \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": container with ID starting with 8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202 not found: ID does not exist" Sep 18 03:00:48.092766 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092697 2575 scope.go:117] "RemoveContainer" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" Sep 18 03:00:48.092956 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092929 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c"} err="failed to get container status \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": rpc error: code = NotFound desc = could not find container \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": container with ID starting with 5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c not found: ID does not exist" Sep 18 03:00:48.092999 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.092959 2575 scope.go:117] "RemoveContainer" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" Sep 18 03:00:48.093206 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.093185 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c"} err="failed to get container status \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": rpc error: code = NotFound desc = could not find container \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": container with ID starting with aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c not found: ID does not exist" Sep 18 03:00:48.093256 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.093208 2575 scope.go:117] "RemoveContainer" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" Sep 18 03:00:48.093518 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.093493 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae"} err="failed to get container status \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": rpc error: code = NotFound desc = could not find container \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": container with ID starting with fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae not found: ID does not exist" Sep 18 03:00:48.093604 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.093519 2575 scope.go:117] "RemoveContainer" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" Sep 18 03:00:48.093790 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.093773 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31"} err="failed to get container status \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": rpc error: code = NotFound desc = could not find container \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": container with ID starting with 1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31 not found: ID does not exist" Sep 18 03:00:48.093850 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.093793 2575 scope.go:117] "RemoveContainer" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" Sep 18 03:00:48.094041 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.094025 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98"} err="failed to get container status \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": rpc error: code = NotFound desc = could not find container \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": container with ID starting with a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98 not found: ID does not exist" Sep 18 03:00:48.094109 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.094040 2575 scope.go:117] "RemoveContainer" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" Sep 18 03:00:48.094279 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.094263 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992"} err="failed to get container status \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": rpc error: code = NotFound desc = could not find container \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": container with ID starting with 80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992 not found: ID does not exist" Sep 18 03:00:48.094320 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.094286 2575 scope.go:117] "RemoveContainer" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" Sep 18 03:00:48.094547 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.094529 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202"} err="failed to get container status \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": rpc error: code = NotFound desc = could not find container \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": container with ID starting with 8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202 not found: ID does not exist" Sep 18 03:00:48.094602 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.094546 2575 scope.go:117] "RemoveContainer" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" Sep 18 03:00:48.094786 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.094770 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c"} err="failed to get container status \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": rpc error: code = NotFound desc = could not find container \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": container with ID starting with 5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c not found: ID does not exist" Sep 18 03:00:48.094857 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.094787 2575 scope.go:117] "RemoveContainer" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" Sep 18 03:00:48.095036 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.095013 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c"} err="failed to get container status \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": rpc error: code = NotFound desc = could not find container \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": container with ID starting with aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c not found: ID does not exist" Sep 18 03:00:48.095098 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.095039 2575 scope.go:117] "RemoveContainer" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" Sep 18 03:00:48.095306 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.095287 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae"} err="failed to get container status \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": rpc error: code = NotFound desc = could not find container \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": container with ID starting with fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae not found: ID does not exist" Sep 18 03:00:48.095306 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.095305 2575 scope.go:117] "RemoveContainer" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" Sep 18 03:00:48.095661 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.095642 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31"} err="failed to get container status \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": rpc error: code = NotFound desc = could not find container \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": container with ID starting with 1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31 not found: ID does not exist" Sep 18 03:00:48.095661 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.095661 2575 scope.go:117] "RemoveContainer" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" Sep 18 03:00:48.095912 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.095890 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98"} err="failed to get container status \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": rpc error: code = NotFound desc = could not find container \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": container with ID starting with a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98 not found: ID does not exist" Sep 18 03:00:48.095912 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.095909 2575 scope.go:117] "RemoveContainer" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" Sep 18 03:00:48.096162 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.096144 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992"} err="failed to get container status \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": rpc error: code = NotFound desc = could not find container \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": container with ID starting with 80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992 not found: ID does not exist" Sep 18 03:00:48.096210 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.096163 2575 scope.go:117] "RemoveContainer" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" Sep 18 03:00:48.096401 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.096386 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202"} err="failed to get container status \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": rpc error: code = NotFound desc = could not find container \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": container with ID starting with 8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202 not found: ID does not exist" Sep 18 03:00:48.096464 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.096403 2575 scope.go:117] "RemoveContainer" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" Sep 18 03:00:48.096651 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.096635 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c"} err="failed to get container status \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": rpc error: code = NotFound desc = could not find container \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": container with ID starting with 5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c not found: ID does not exist" Sep 18 03:00:48.096651 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.096650 2575 scope.go:117] "RemoveContainer" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" Sep 18 03:00:48.096875 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.096852 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c"} err="failed to get container status \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": rpc error: code = NotFound desc = could not find container \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": container with ID starting with aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c not found: ID does not exist" Sep 18 03:00:48.096875 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.096873 2575 scope.go:117] "RemoveContainer" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" Sep 18 03:00:48.097132 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097108 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae"} err="failed to get container status \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": rpc error: code = NotFound desc = could not find container \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": container with ID starting with fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae not found: ID does not exist" Sep 18 03:00:48.097182 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097135 2575 scope.go:117] "RemoveContainer" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" Sep 18 03:00:48.097326 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097308 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-web-config" (OuterVolumeSpecName: "web-config") pod "884a0685-f5ff-4394-b383-94afb8ec9a81" (UID: "884a0685-f5ff-4394-b383-94afb8ec9a81"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 18 03:00:48.097378 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097354 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31"} err="failed to get container status \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": rpc error: code = NotFound desc = could not find container \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": container with ID starting with 1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31 not found: ID does not exist" Sep 18 03:00:48.097378 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097372 2575 scope.go:117] "RemoveContainer" containerID="a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98" Sep 18 03:00:48.097615 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097599 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98"} err="failed to get container status \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": rpc error: code = NotFound desc = could not find container \"a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98\": container with ID starting with a6f5af3ce6a81b1108ea556bce838c219a6ed5d59d81adad6e0d2ee2bc6e6d98 not found: ID does not exist" Sep 18 03:00:48.097660 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097616 2575 scope.go:117] "RemoveContainer" containerID="80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992" Sep 18 03:00:48.097828 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097812 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992"} err="failed to get container status \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": rpc error: code = NotFound desc = could not find container \"80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992\": container with ID starting with 80c90bae3ce1330a4038d8bc0499d4465f995359b3341f6f3d309923cb813992 not found: ID does not exist" Sep 18 03:00:48.097880 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.097831 2575 scope.go:117] "RemoveContainer" containerID="8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202" Sep 18 03:00:48.098045 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098026 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202"} err="failed to get container status \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": rpc error: code = NotFound desc = could not find container \"8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202\": container with ID starting with 8636da1708cd4125cbda6fa6e0763b95aa282110c184aeff41d8ed2d1c25e202 not found: ID does not exist" Sep 18 03:00:48.098090 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098046 2575 scope.go:117] "RemoveContainer" containerID="5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c" Sep 18 03:00:48.098259 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098245 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c"} err="failed to get container status \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": rpc error: code = NotFound desc = could not find container \"5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c\": container with ID starting with 5016dc1accbcd053434d67fd3ecaf1ccee9f8b36023de8a81ab22415d691554c not found: ID does not exist" Sep 18 03:00:48.098305 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098259 2575 scope.go:117] "RemoveContainer" containerID="aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c" Sep 18 03:00:48.098517 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098500 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c"} err="failed to get container status \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": rpc error: code = NotFound desc = could not find container \"aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c\": container with ID starting with aa292bfaa7173489b46e7614182015b33e14d4ad6862c56f8922660da1dd8a0c not found: ID does not exist" Sep 18 03:00:48.098576 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098517 2575 scope.go:117] "RemoveContainer" containerID="fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae" Sep 18 03:00:48.098731 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098717 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae"} err="failed to get container status \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": rpc error: code = NotFound desc = could not find container \"fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae\": container with ID starting with fe0e414647732c7e3883830870fac609d7bf79ca504c236909c68a4c71af4fae not found: ID does not exist" Sep 18 03:00:48.098731 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098731 2575 scope.go:117] "RemoveContainer" containerID="1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31" Sep 18 03:00:48.098912 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.098896 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31"} err="failed to get container status \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": rpc error: code = NotFound desc = could not find container \"1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31\": container with ID starting with 1acb7533d8207090205b276dba61edae1de7f4cc5b13fb8d1f307a2a21957d31 not found: ID does not exist" Sep 18 03:00:48.182950 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.182928 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.182950 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.182949 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.182976 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-web-config\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.182986 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.182995 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64glm\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-kube-api-access-64glm\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183003 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183011 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-grpc-tls\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183018 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-db\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183026 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-metrics-client-certs\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183033 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/884a0685-f5ff-4394-b383-94afb8ec9a81-tls-assets\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183041 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-kube-rbac-proxy\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183046 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183048 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183324 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183056 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-config\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183324 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183064 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183324 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183071 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/884a0685-f5ff-4394-b383-94afb8ec9a81-config-out\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183324 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183078 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-configmap-metrics-client-ca\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183324 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183086 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183324 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183094 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/884a0685-f5ff-4394-b383-94afb8ec9a81-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.183324 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.183101 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/884a0685-f5ff-4394-b383-94afb8ec9a81-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:00:48.362850 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.362827 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:00:48.368853 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.368834 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:00:48.398953 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.398934 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:00:48.399187 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399176 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy-web" Sep 18 03:00:48.399235 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399189 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy-web" Sep 18 03:00:48.399235 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399201 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="prometheus" Sep 18 03:00:48.399235 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399206 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="prometheus" Sep 18 03:00:48.399235 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399213 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy" Sep 18 03:00:48.399235 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399218 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy" Sep 18 03:00:48.399235 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399226 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="config-reloader" Sep 18 03:00:48.399235 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399231 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="config-reloader" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399239 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="alertmanager" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399244 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="alertmanager" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399252 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="thanos-sidecar" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399257 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="thanos-sidecar" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399263 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="config-reloader" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399269 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="config-reloader" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399274 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy-metric" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399278 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy-metric" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399286 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="init-config-reloader" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399290 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="init-config-reloader" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399297 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy-thanos" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399302 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy-thanos" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399308 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="init-config-reloader" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399313 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="init-config-reloader" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399318 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="563dd285-5e0d-47b3-85be-d91be717ef1e" containerName="console" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399322 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="563dd285-5e0d-47b3-85be-d91be717ef1e" containerName="console" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399328 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy-web" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399332 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy-web" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399339 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399343 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399349 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="prom-label-proxy" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399354 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="prom-label-proxy" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399392 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="563dd285-5e0d-47b3-85be-d91be717ef1e" containerName="console" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399398 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy-metric" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399405 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy-web" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399426 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="thanos-sidecar" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399435 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="config-reloader" Sep 18 03:00:48.399436 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399445 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="config-reloader" Sep 18 03:00:48.400163 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399453 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy-thanos" Sep 18 03:00:48.400163 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399458 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="prometheus" Sep 18 03:00:48.400163 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399463 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy" Sep 18 03:00:48.400163 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399468 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="kube-rbac-proxy-web" Sep 18 03:00:48.400163 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399473 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" containerName="kube-rbac-proxy" Sep 18 03:00:48.400163 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399478 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="prom-label-proxy" Sep 18 03:00:48.400163 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.399483 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9dde7e7-7a43-4b44-82db-bf5853294e91" containerName="alertmanager" Sep 18 03:00:48.402949 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.402934 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.405752 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.405731 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 18 03:00:48.405839 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.405731 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 18 03:00:48.405896 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.405846 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 18 03:00:48.405896 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.405849 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 18 03:00:48.405896 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.405862 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 18 03:00:48.406160 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.406144 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 18 03:00:48.406209 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.406179 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-452zc\"" Sep 18 03:00:48.406250 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.406194 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 18 03:00:48.406327 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.406311 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 18 03:00:48.406391 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.406327 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 18 03:00:48.406845 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.406829 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 18 03:00:48.407021 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.406998 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 18 03:00:48.407440 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.407404 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 18 03:00:48.407550 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.407440 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2oihb40ijc9ic\"" Sep 18 03:00:48.407550 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.407430 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 18 03:00:48.410051 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.409966 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 18 03:00:48.413917 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.413900 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 18 03:00:48.428827 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.428806 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:00:48.485444 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485403 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485554 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485554 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485554 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485517 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485554 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95c42a57-b0c1-4b35-b225-0449a3fba185-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485569 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-web-config\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-config\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.485765 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.486060 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95c42a57-b0c1-4b35-b225-0449a3fba185-config-out\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.486060 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.486060 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.486060 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.486060 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44t5x\" (UniqueName: \"kubernetes.io/projected/95c42a57-b0c1-4b35-b225-0449a3fba185-kube-api-access-44t5x\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.486060 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.486060 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.485961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587208 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587302 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587237 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95c42a57-b0c1-4b35-b225-0449a3fba185-config-out\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587302 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587263 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587302 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587559 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587311 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587559 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44t5x\" (UniqueName: \"kubernetes.io/projected/95c42a57-b0c1-4b35-b225-0449a3fba185-kube-api-access-44t5x\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587559 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587374 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587559 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587559 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587559 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587481 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587559 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587559 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587584 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95c42a57-b0c1-4b35-b225-0449a3fba185-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587688 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-web-config\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.587926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-config\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.588314 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.587998 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.588314 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.588141 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.588314 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.588297 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.589546 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.589519 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.589648 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.589540 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.589852 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.589829 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.590978 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.590345 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.590978 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.590769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-config\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.591196 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.591139 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.591196 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.591144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.591803 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.591780 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95c42a57-b0c1-4b35-b225-0449a3fba185-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.592390 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.591876 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-web-config\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.592390 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.592094 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.592390 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.592266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.592390 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.592300 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95c42a57-b0c1-4b35-b225-0449a3fba185-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.592390 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.592318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.592708 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.592693 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95c42a57-b0c1-4b35-b225-0449a3fba185-config-out\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.592768 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.592735 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.593532 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.593513 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95c42a57-b0c1-4b35-b225-0449a3fba185-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.600598 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.600555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44t5x\" (UniqueName: \"kubernetes.io/projected/95c42a57-b0c1-4b35-b225-0449a3fba185-kube-api-access-44t5x\") pod \"prometheus-k8s-0\" (UID: \"95c42a57-b0c1-4b35-b225-0449a3fba185\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.712698 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.712671 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:48.994424 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:48.994264 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 18 03:00:48.997600 ip-10-0-134-53 kubenswrapper[2575]: W0918 03:00:48.997575 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c42a57_b0c1_4b35_b225_0449a3fba185.slice/crio-b13300d2f8f3100c55288153bc421586268fd6085881b9f4d3c37be882d88999 WatchSource:0}: Error finding container b13300d2f8f3100c55288153bc421586268fd6085881b9f4d3c37be882d88999: Status 404 returned error can't find the container with id b13300d2f8f3100c55288153bc421586268fd6085881b9f4d3c37be882d88999 Sep 18 03:00:49.042210 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:49.042186 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c42a57-b0c1-4b35-b225-0449a3fba185","Type":"ContainerStarted","Data":"b13300d2f8f3100c55288153bc421586268fd6085881b9f4d3c37be882d88999"} Sep 18 03:00:49.211848 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:49.211819 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="884a0685-f5ff-4394-b383-94afb8ec9a81" path="/var/lib/kubelet/pods/884a0685-f5ff-4394-b383-94afb8ec9a81/volumes" Sep 18 03:00:50.047336 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:50.047255 2575 generic.go:356] "Generic (PLEG): container finished" podID="95c42a57-b0c1-4b35-b225-0449a3fba185" containerID="f43559167ba2323e93fb93d1860515d2082812be8f872b746d528b674d0925fb" exitCode=0 Sep 18 03:00:50.047336 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:50.047289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c42a57-b0c1-4b35-b225-0449a3fba185","Type":"ContainerDied","Data":"f43559167ba2323e93fb93d1860515d2082812be8f872b746d528b674d0925fb"} Sep 18 03:00:51.042696 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.042666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:51.054102 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.054073 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c42a57-b0c1-4b35-b225-0449a3fba185","Type":"ContainerStarted","Data":"d4aa8061f34005f256a866e2a4597d8fc1d1bd34bb84e6d053d75bad10bbd5b5"} Sep 18 03:00:51.054475 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.054150 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c42a57-b0c1-4b35-b225-0449a3fba185","Type":"ContainerStarted","Data":"a54d6f5db17baa35cd6e21d3a858f0a9245ec3d1a3cdab2cec252ca5fff9e07e"} Sep 18 03:00:51.054475 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.054192 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c42a57-b0c1-4b35-b225-0449a3fba185","Type":"ContainerStarted","Data":"7edb2af5cf157006e49d0716517fd517f26a7865d9b7dd9cc1dacc89a9142d60"} Sep 18 03:00:51.054475 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.054228 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c42a57-b0c1-4b35-b225-0449a3fba185","Type":"ContainerStarted","Data":"2f211517491923bb697f7b8195936abde7480c162702194d3eb595d60a829a58"} Sep 18 03:00:51.054475 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.054263 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c42a57-b0c1-4b35-b225-0449a3fba185","Type":"ContainerStarted","Data":"e4bcc2751301608f0caf3a547e1d651aaaff85288c090c65d745db2f1a388061"} Sep 18 03:00:51.054475 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.054303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95c42a57-b0c1-4b35-b225-0449a3fba185","Type":"ContainerStarted","Data":"77913a062e4659352ae3c5aa9e8b01f13d3ad6f0789b7cba51dd73de96a970aa"} Sep 18 03:00:51.089267 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.089213 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.070310169 podStartE2EDuration="3.089193825s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.883656ms" isStatefulPod=false podCreationTimestamp="2026-09-18 03:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:00:51.087485553 +0000 UTC m=+170.129808960" watchObservedRunningTime="2026-09-18 03:00:51.089193825 +0000 UTC m=+170.131517233" Sep 18 03:00:51.120171 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:51.120144 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:53.713592 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:53.713557 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:00:57.692119 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:57.692090 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:00:57.794757 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:00:57.794729 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:01:35.028903 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:01:35.028872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:01:35.129537 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:01:35.129509 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:01:38.038920 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:01:38.038887 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:01:48.713248 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:01:48.713209 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:01:48.727933 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:01:48.727912 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:01:49.284495 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:01:49.284468 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 18 03:02:06.967940 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:06.967905 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:07.063002 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:07.062974 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:28.705760 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:28.705681 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:29.676819 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:29.676783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:32.326926 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:32.326893 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:32.436008 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:32.435976 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:34.825575 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:34.825542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:34.959619 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:34.959577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:37.341183 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:37.341132 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:37.540068 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:37.540036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:37.666729 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:37.666647 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:44.560226 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:44.560191 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:47.047627 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:47.047589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:47.160201 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:47.160170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:59.209233 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:59.209193 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:02:59.305465 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:02:59.305430 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:00.574679 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.574650 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z"] Sep 18 03:03:00.577017 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.576999 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" Sep 18 03:03:00.579988 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.579966 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Sep 18 03:03:00.580200 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.580185 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Sep 18 03:03:00.581192 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.581167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-kv95x\"" Sep 18 03:03:00.591431 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.591389 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z"] Sep 18 03:03:00.624669 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.624648 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa3e368c-4bc8-4eee-9894-442f039acd76-tmp\") pod \"jobset-operator-5bc45f897-5sm4z\" (UID: \"fa3e368c-4bc8-4eee-9894-442f039acd76\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" Sep 18 03:03:00.624759 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.624691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxdkl\" (UniqueName: \"kubernetes.io/projected/fa3e368c-4bc8-4eee-9894-442f039acd76-kube-api-access-pxdkl\") pod \"jobset-operator-5bc45f897-5sm4z\" (UID: \"fa3e368c-4bc8-4eee-9894-442f039acd76\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" Sep 18 03:03:00.725456 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.725430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa3e368c-4bc8-4eee-9894-442f039acd76-tmp\") pod \"jobset-operator-5bc45f897-5sm4z\" (UID: \"fa3e368c-4bc8-4eee-9894-442f039acd76\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" Sep 18 03:03:00.725540 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.725480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxdkl\" (UniqueName: \"kubernetes.io/projected/fa3e368c-4bc8-4eee-9894-442f039acd76-kube-api-access-pxdkl\") pod \"jobset-operator-5bc45f897-5sm4z\" (UID: \"fa3e368c-4bc8-4eee-9894-442f039acd76\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" Sep 18 03:03:00.725818 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.725801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa3e368c-4bc8-4eee-9894-442f039acd76-tmp\") pod \"jobset-operator-5bc45f897-5sm4z\" (UID: \"fa3e368c-4bc8-4eee-9894-442f039acd76\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" Sep 18 03:03:00.733815 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.733796 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxdkl\" (UniqueName: \"kubernetes.io/projected/fa3e368c-4bc8-4eee-9894-442f039acd76-kube-api-access-pxdkl\") pod \"jobset-operator-5bc45f897-5sm4z\" (UID: \"fa3e368c-4bc8-4eee-9894-442f039acd76\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" Sep 18 03:03:00.896665 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:00.896618 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" Sep 18 03:03:01.170633 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:01.170608 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z"] Sep 18 03:03:01.172203 ip-10-0-134-53 kubenswrapper[2575]: W0918 03:03:01.172178 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa3e368c_4bc8_4eee_9894_442f039acd76.slice/crio-40fad086be00ab472c18279234039d2d8d15fe1e59ba830b1082106396dc0e49 WatchSource:0}: Error finding container 40fad086be00ab472c18279234039d2d8d15fe1e59ba830b1082106396dc0e49: Status 404 returned error can't find the container with id 40fad086be00ab472c18279234039d2d8d15fe1e59ba830b1082106396dc0e49 Sep 18 03:03:01.528780 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:01.528699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" event={"ID":"fa3e368c-4bc8-4eee-9894-442f039acd76","Type":"ContainerStarted","Data":"40fad086be00ab472c18279234039d2d8d15fe1e59ba830b1082106396dc0e49"} Sep 18 03:03:03.538557 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:03.538527 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 03:03:03.539832 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:03.538579 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 03:03:03.541605 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:03.541588 2575 kubelet.go:1648] "Image garbage collection succeeded" Sep 18 03:03:04.545896 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:04.545842 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" event={"ID":"fa3e368c-4bc8-4eee-9894-442f039acd76","Type":"ContainerStarted","Data":"beb0902c2d08bb6ba4b8b576bb2ca3f8219ecfe49376b9dfce2f8b2e442f6a27"} Sep 18 03:03:04.568423 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:04.568365 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-5sm4z" podStartSLOduration=2.184339959 podStartE2EDuration="4.56835073s" totalImagesPullingTime="2.384010771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:03:04.567064889 +0000 UTC m=+303.609388297" watchObservedRunningTime="2026-09-18 03:03:04.56835073 +0000 UTC m=+303.610674135" Sep 18 03:03:08.515173 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:08.515143 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:10.119447 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:10.119399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:16.811571 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:16.811538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:16.886582 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:16.886557 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:26.310350 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:26.310315 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:26.409451 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:26.409400 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:30.067024 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:30.066990 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:30.150682 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:30.150652 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:34.802333 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:34.802301 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:03:34.892196 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:03:34.892168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:04:00.691185 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:04:00.691092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:04:00.799834 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:04:00.799788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:04:02.156123 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:04:02.156085 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:04:02.650833 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:04:02.650803 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:04:02.749810 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:04:02.749779 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:04:37.756640 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:04:37.756598 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:04:49.099805 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:04:49.099759 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:04:49.233158 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:04:49.233118 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:05:05.714838 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:05.714788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:05:05.816910 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:05.816886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:05:05.938429 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:05.938378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:05:05.981684 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:05.981624 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl"] Sep 18 03:05:05.984954 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:05.984939 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:05:05.987391 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:05.987363 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-f595k\"/\"kube-root-ca.crt\"" Sep 18 03:05:05.987530 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:05.987400 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-f595k\"/\"default-dockercfg-vzvbt\"" Sep 18 03:05:05.987530 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:05.987433 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-f595k\"/\"openshift-service-ca.crt\"" Sep 18 03:05:06.001426 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:06.001385 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl"] Sep 18 03:05:06.075738 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:06.075710 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwjg2\" (UniqueName: \"kubernetes.io/projected/c21da6cd-113f-4a6b-a70d-12d90356ffb6-kube-api-access-hwjg2\") pod \"progression-enabled-node-0-0-78ssl\" (UID: \"c21da6cd-113f-4a6b-a70d-12d90356ffb6\") " pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:05:06.176456 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:06.176405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwjg2\" (UniqueName: \"kubernetes.io/projected/c21da6cd-113f-4a6b-a70d-12d90356ffb6-kube-api-access-hwjg2\") pod \"progression-enabled-node-0-0-78ssl\" (UID: \"c21da6cd-113f-4a6b-a70d-12d90356ffb6\") " pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:05:06.185497 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:06.185479 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwjg2\" (UniqueName: \"kubernetes.io/projected/c21da6cd-113f-4a6b-a70d-12d90356ffb6-kube-api-access-hwjg2\") pod \"progression-enabled-node-0-0-78ssl\" (UID: \"c21da6cd-113f-4a6b-a70d-12d90356ffb6\") " pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:05:06.295394 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:06.295337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:05:06.574976 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:06.574949 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl"] Sep 18 03:05:06.578338 ip-10-0-134-53 kubenswrapper[2575]: W0918 03:05:06.578309 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21da6cd_113f_4a6b_a70d_12d90356ffb6.slice/crio-d981d5abba2ee98e667d3c281667591a8efd6588e9f76bcd744c888b61b40330 WatchSource:0}: Error finding container d981d5abba2ee98e667d3c281667591a8efd6588e9f76bcd744c888b61b40330: Status 404 returned error can't find the container with id d981d5abba2ee98e667d3c281667591a8efd6588e9f76bcd744c888b61b40330 Sep 18 03:05:06.580727 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:06.580710 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:05:07.009382 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:05:07.009304 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" event={"ID":"c21da6cd-113f-4a6b-a70d-12d90356ffb6","Type":"ContainerStarted","Data":"d981d5abba2ee98e667d3c281667591a8efd6588e9f76bcd744c888b61b40330"} Sep 18 03:06:22.052285 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:06:22.052242 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:06:48.833069 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:06:48.832892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:07:06.520743 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:06.520709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" event={"ID":"c21da6cd-113f-4a6b-a70d-12d90356ffb6","Type":"ContainerStarted","Data":"e533a53c534aad09d063b363d0d1ba200c595d8ac5de394a9d0932465b5e41fd"} Sep 18 03:07:06.521125 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:06.520846 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:07:06.549065 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:06.549023 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" podStartSLOduration=2.563925397 podStartE2EDuration="2m1.549008214s" totalImagesPullingTime="1m58.985082817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:07:06.547475882 +0000 UTC m=+545.589799290" watchObservedRunningTime="2026-09-18 03:07:06.549008214 +0000 UTC m=+545.591331620" Sep 18 03:07:07.524115 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:07.524087 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:07:23.909290 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:23.909240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:07:24.009842 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:24.009814 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:07:28.656483 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:28.656440 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" podUID="c21da6cd-113f-4a6b-a70d-12d90356ffb6" containerName="node" probeResult="failure" output="Get \"http://10.133.0.23:28080/metrics\": read tcp 10.133.0.2:50096->10.133.0.23:28080: read: connection reset by peer" Sep 18 03:07:29.521689 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:29.521647 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" podUID="c21da6cd-113f-4a6b-a70d-12d90356ffb6" containerName="node" probeResult="failure" output="Get \"http://10.133.0.23:28080/metrics\": dial tcp 10.133.0.23:28080: connect: connection refused" Sep 18 03:07:29.521883 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:29.521770 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:07:29.522266 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:29.522235 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" podUID="c21da6cd-113f-4a6b-a70d-12d90356ffb6" containerName="node" probeResult="failure" output="Get \"http://10.133.0.23:28080/metrics\": dial tcp 10.133.0.23:28080: connect: connection refused" Sep 18 03:07:29.609578 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:29.609551 2575 generic.go:356] "Generic (PLEG): container finished" podID="c21da6cd-113f-4a6b-a70d-12d90356ffb6" containerID="e533a53c534aad09d063b363d0d1ba200c595d8ac5de394a9d0932465b5e41fd" exitCode=0 Sep 18 03:07:29.609713 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:29.609616 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" event={"ID":"c21da6cd-113f-4a6b-a70d-12d90356ffb6","Type":"ContainerDied","Data":"e533a53c534aad09d063b363d0d1ba200c595d8ac5de394a9d0932465b5e41fd"} Sep 18 03:07:30.759203 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:30.759178 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:07:30.830818 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:30.830788 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwjg2\" (UniqueName: \"kubernetes.io/projected/c21da6cd-113f-4a6b-a70d-12d90356ffb6-kube-api-access-hwjg2\") pod \"c21da6cd-113f-4a6b-a70d-12d90356ffb6\" (UID: \"c21da6cd-113f-4a6b-a70d-12d90356ffb6\") " Sep 18 03:07:30.832744 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:30.832724 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c21da6cd-113f-4a6b-a70d-12d90356ffb6-kube-api-access-hwjg2" (OuterVolumeSpecName: "kube-api-access-hwjg2") pod "c21da6cd-113f-4a6b-a70d-12d90356ffb6" (UID: "c21da6cd-113f-4a6b-a70d-12d90356ffb6"). InnerVolumeSpecName "kube-api-access-hwjg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:07:30.931934 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:30.931883 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwjg2\" (UniqueName: \"kubernetes.io/projected/c21da6cd-113f-4a6b-a70d-12d90356ffb6-kube-api-access-hwjg2\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:07:31.617871 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:31.617851 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" Sep 18 03:07:31.618035 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:31.617847 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl" event={"ID":"c21da6cd-113f-4a6b-a70d-12d90356ffb6","Type":"ContainerDied","Data":"d981d5abba2ee98e667d3c281667591a8efd6588e9f76bcd744c888b61b40330"} Sep 18 03:07:31.618035 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:31.617987 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d981d5abba2ee98e667d3c281667591a8efd6588e9f76bcd744c888b61b40330" Sep 18 03:07:32.432529 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.432497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:07:32.460320 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.460293 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg"] Sep 18 03:07:32.465613 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.461117 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c21da6cd-113f-4a6b-a70d-12d90356ffb6" containerName="node" Sep 18 03:07:32.465613 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.461142 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c21da6cd-113f-4a6b-a70d-12d90356ffb6" containerName="node" Sep 18 03:07:32.465613 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.461300 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c21da6cd-113f-4a6b-a70d-12d90356ffb6" containerName="node" Sep 18 03:07:32.480618 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.480598 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:32.483018 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.482992 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg"] Sep 18 03:07:32.485050 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.485030 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-f595k\"/\"default-dockercfg-vzvbt\"" Sep 18 03:07:32.485177 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.485161 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-f595k\"/\"kube-root-ca.crt\"" Sep 18 03:07:32.486001 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.485984 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-f595k\"/\"openshift-service-ca.crt\"" Sep 18 03:07:32.546539 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.546513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hpsr\" (UniqueName: \"kubernetes.io/projected/445b9734-caf8-4f09-bd93-e86cc23b6512-kube-api-access-7hpsr\") pod \"progression-disabled-node-0-0-qhrgg\" (UID: \"445b9734-caf8-4f09-bd93-e86cc23b6512\") " pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:32.647246 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.647220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hpsr\" (UniqueName: \"kubernetes.io/projected/445b9734-caf8-4f09-bd93-e86cc23b6512-kube-api-access-7hpsr\") pod \"progression-disabled-node-0-0-qhrgg\" (UID: \"445b9734-caf8-4f09-bd93-e86cc23b6512\") " pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:32.656683 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.656663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hpsr\" (UniqueName: \"kubernetes.io/projected/445b9734-caf8-4f09-bd93-e86cc23b6512-kube-api-access-7hpsr\") pod \"progression-disabled-node-0-0-qhrgg\" (UID: \"445b9734-caf8-4f09-bd93-e86cc23b6512\") " pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:32.790202 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:32.790153 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:33.082479 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:33.082458 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg"] Sep 18 03:07:33.084893 ip-10-0-134-53 kubenswrapper[2575]: W0918 03:07:33.084868 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445b9734_caf8_4f09_bd93_e86cc23b6512.slice/crio-0bda03eb6fe7e28033121882449db0bb853ee697a393033fcd63f43284c12358 WatchSource:0}: Error finding container 0bda03eb6fe7e28033121882449db0bb853ee697a393033fcd63f43284c12358: Status 404 returned error can't find the container with id 0bda03eb6fe7e28033121882449db0bb853ee697a393033fcd63f43284c12358 Sep 18 03:07:33.626896 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:33.626865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" event={"ID":"445b9734-caf8-4f09-bd93-e86cc23b6512","Type":"ContainerStarted","Data":"8fb23dcd90f6c5f70743b98e2784adcdd0368efa481dda950cab6b2b43f0a5bc"} Sep 18 03:07:33.627301 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:33.626918 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" event={"ID":"445b9734-caf8-4f09-bd93-e86cc23b6512","Type":"ContainerStarted","Data":"0bda03eb6fe7e28033121882449db0bb853ee697a393033fcd63f43284c12358"} Sep 18 03:07:33.627301 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:33.626954 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:33.648893 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:33.648852 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" podStartSLOduration=1.6488358459999999 podStartE2EDuration="1.648835846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:07:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:07:33.648123466 +0000 UTC m=+572.690446873" watchObservedRunningTime="2026-09-18 03:07:33.648835846 +0000 UTC m=+572.691159252" Sep 18 03:07:35.633701 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:35.633667 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:55.925130 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:55.925090 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:07:56.025861 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:56.025825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:07:56.632306 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:56.632265 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" podUID="445b9734-caf8-4f09-bd93-e86cc23b6512" containerName="node" probeResult="failure" output="Get \"http://10.133.0.24:28080/metrics\": dial tcp 10.133.0.24:28080: connect: connection refused" Sep 18 03:07:56.718733 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:56.718705 2575 generic.go:356] "Generic (PLEG): container finished" podID="445b9734-caf8-4f09-bd93-e86cc23b6512" containerID="8fb23dcd90f6c5f70743b98e2784adcdd0368efa481dda950cab6b2b43f0a5bc" exitCode=0 Sep 18 03:07:56.718872 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:56.718773 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" event={"ID":"445b9734-caf8-4f09-bd93-e86cc23b6512","Type":"ContainerDied","Data":"8fb23dcd90f6c5f70743b98e2784adcdd0368efa481dda950cab6b2b43f0a5bc"} Sep 18 03:07:57.852654 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:57.852631 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:57.938909 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:57.938883 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hpsr\" (UniqueName: \"kubernetes.io/projected/445b9734-caf8-4f09-bd93-e86cc23b6512-kube-api-access-7hpsr\") pod \"445b9734-caf8-4f09-bd93-e86cc23b6512\" (UID: \"445b9734-caf8-4f09-bd93-e86cc23b6512\") " Sep 18 03:07:57.940795 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:57.940773 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445b9734-caf8-4f09-bd93-e86cc23b6512-kube-api-access-7hpsr" (OuterVolumeSpecName: "kube-api-access-7hpsr") pod "445b9734-caf8-4f09-bd93-e86cc23b6512" (UID: "445b9734-caf8-4f09-bd93-e86cc23b6512"). InnerVolumeSpecName "kube-api-access-7hpsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:07:58.039632 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:58.039581 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hpsr\" (UniqueName: \"kubernetes.io/projected/445b9734-caf8-4f09-bd93-e86cc23b6512-kube-api-access-7hpsr\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:07:58.728433 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:58.728385 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" event={"ID":"445b9734-caf8-4f09-bd93-e86cc23b6512","Type":"ContainerDied","Data":"0bda03eb6fe7e28033121882449db0bb853ee697a393033fcd63f43284c12358"} Sep 18 03:07:58.728602 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:58.728437 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg" Sep 18 03:07:58.728602 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:07:58.728477 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bda03eb6fe7e28033121882449db0bb853ee697a393033fcd63f43284c12358" Sep 18 03:08:03.565779 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:03.565752 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 03:08:03.573855 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:03.565958 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 03:08:07.438300 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.438269 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49"] Sep 18 03:08:07.438767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.438576 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="445b9734-caf8-4f09-bd93-e86cc23b6512" containerName="node" Sep 18 03:08:07.438767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.438588 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="445b9734-caf8-4f09-bd93-e86cc23b6512" containerName="node" Sep 18 03:08:07.438767 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.438630 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="445b9734-caf8-4f09-bd93-e86cc23b6512" containerName="node" Sep 18 03:08:07.440850 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.440836 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:07.443450 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.443405 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-f595k\"/\"default-dockercfg-vzvbt\"" Sep 18 03:08:07.443450 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.443405 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-f595k\"/\"openshift-service-ca.crt\"" Sep 18 03:08:07.443656 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.443511 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-f595k\"/\"kube-root-ca.crt\"" Sep 18 03:08:07.444527 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.444501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:08:07.454381 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.454361 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49"] Sep 18 03:08:07.607241 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.607216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tsld\" (UniqueName: \"kubernetes.io/projected/39a38874-de46-49c9-b59d-58989476cf54-kube-api-access-5tsld\") pod \"progression-invalid-node-0-0-jmp49\" (UID: \"39a38874-de46-49c9-b59d-58989476cf54\") " pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:07.708546 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.708489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tsld\" (UniqueName: \"kubernetes.io/projected/39a38874-de46-49c9-b59d-58989476cf54-kube-api-access-5tsld\") pod \"progression-invalid-node-0-0-jmp49\" (UID: \"39a38874-de46-49c9-b59d-58989476cf54\") " pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:07.717650 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.717630 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tsld\" (UniqueName: \"kubernetes.io/projected/39a38874-de46-49c9-b59d-58989476cf54-kube-api-access-5tsld\") pod \"progression-invalid-node-0-0-jmp49\" (UID: \"39a38874-de46-49c9-b59d-58989476cf54\") " pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:07.749488 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:07.749460 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:08.017365 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:08.017344 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49"] Sep 18 03:08:08.019565 ip-10-0-134-53 kubenswrapper[2575]: W0918 03:08:08.019539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a38874_de46_49c9_b59d_58989476cf54.slice/crio-8f4878ba9f02df295852daf7447f5a47bc4010b8cf736cab37f6623b105acb29 WatchSource:0}: Error finding container 8f4878ba9f02df295852daf7447f5a47bc4010b8cf736cab37f6623b105acb29: Status 404 returned error can't find the container with id 8f4878ba9f02df295852daf7447f5a47bc4010b8cf736cab37f6623b105acb29 Sep 18 03:08:08.767626 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:08.767592 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" event={"ID":"39a38874-de46-49c9-b59d-58989476cf54","Type":"ContainerStarted","Data":"e51e2a6fcae48f1b5cf1720d10a5404e4877e9efef19d6f5a3cd6f8f19855a84"} Sep 18 03:08:08.768011 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:08.767644 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" event={"ID":"39a38874-de46-49c9-b59d-58989476cf54","Type":"ContainerStarted","Data":"8f4878ba9f02df295852daf7447f5a47bc4010b8cf736cab37f6623b105acb29"} Sep 18 03:08:08.768011 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:08.767669 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:08.786831 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:08.786778 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" podStartSLOduration=1.786764051 podStartE2EDuration="1.786764051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:08:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:08:08.78576444 +0000 UTC m=+607.828087848" watchObservedRunningTime="2026-09-18 03:08:08.786764051 +0000 UTC m=+607.829087456" Sep 18 03:08:10.774114 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:10.774084 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:22.488832 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:22.488754 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:08:23.911482 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:23.911448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:08:31.015344 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:31.015301 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" podUID="39a38874-de46-49c9-b59d-58989476cf54" containerName="node" probeResult="failure" output="Get \"http://10.133.0.25:28080/metrics\": read tcp 10.133.0.2:38390->10.133.0.25:28080: read: connection reset by peer" Sep 18 03:08:31.772358 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:31.772314 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" podUID="39a38874-de46-49c9-b59d-58989476cf54" containerName="node" probeResult="failure" output="Get \"http://10.133.0.25:28080/metrics\": dial tcp 10.133.0.25:28080: connect: connection refused" Sep 18 03:08:31.772550 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:31.772461 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:31.773006 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:31.772981 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" podUID="39a38874-de46-49c9-b59d-58989476cf54" containerName="node" probeResult="failure" output="Get \"http://10.133.0.25:28080/metrics\": dial tcp 10.133.0.25:28080: connect: connection refused" Sep 18 03:08:31.866497 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:31.866464 2575 generic.go:356] "Generic (PLEG): container finished" podID="39a38874-de46-49c9-b59d-58989476cf54" containerID="e51e2a6fcae48f1b5cf1720d10a5404e4877e9efef19d6f5a3cd6f8f19855a84" exitCode=0 Sep 18 03:08:31.866659 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:31.866537 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" event={"ID":"39a38874-de46-49c9-b59d-58989476cf54","Type":"ContainerDied","Data":"e51e2a6fcae48f1b5cf1720d10a5404e4877e9efef19d6f5a3cd6f8f19855a84"} Sep 18 03:08:32.992610 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:32.992584 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:33.091940 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:33.091903 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tsld\" (UniqueName: \"kubernetes.io/projected/39a38874-de46-49c9-b59d-58989476cf54-kube-api-access-5tsld\") pod \"39a38874-de46-49c9-b59d-58989476cf54\" (UID: \"39a38874-de46-49c9-b59d-58989476cf54\") " Sep 18 03:08:33.093920 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:33.093897 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39a38874-de46-49c9-b59d-58989476cf54-kube-api-access-5tsld" (OuterVolumeSpecName: "kube-api-access-5tsld") pod "39a38874-de46-49c9-b59d-58989476cf54" (UID: "39a38874-de46-49c9-b59d-58989476cf54"). InnerVolumeSpecName "kube-api-access-5tsld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:08:33.193116 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:33.193041 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tsld\" (UniqueName: \"kubernetes.io/projected/39a38874-de46-49c9-b59d-58989476cf54-kube-api-access-5tsld\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:08:33.876175 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:33.876147 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" Sep 18 03:08:33.876175 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:33.876173 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49" event={"ID":"39a38874-de46-49c9-b59d-58989476cf54","Type":"ContainerDied","Data":"8f4878ba9f02df295852daf7447f5a47bc4010b8cf736cab37f6623b105acb29"} Sep 18 03:08:33.876401 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:08:33.876211 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f4878ba9f02df295852daf7447f5a47bc4010b8cf736cab37f6623b105acb29" Sep 18 03:09:04.423497 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:09:04.423467 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:05.412263 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:05.412233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:17.097834 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.097799 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:17.141128 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.141100 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457"] Sep 18 03:10:17.141389 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.141378 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39a38874-de46-49c9-b59d-58989476cf54" containerName="node" Sep 18 03:10:17.141468 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.141390 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="39a38874-de46-49c9-b59d-58989476cf54" containerName="node" Sep 18 03:10:17.141506 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.141470 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="39a38874-de46-49c9-b59d-58989476cf54" containerName="node" Sep 18 03:10:17.143394 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.143380 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" Sep 18 03:10:17.145928 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.145901 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-f595k\"/\"default-dockercfg-vzvbt\"" Sep 18 03:10:17.146988 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.146974 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-f595k\"/\"kube-root-ca.crt\"" Sep 18 03:10:17.147070 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.147050 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-f595k\"/\"openshift-service-ca.crt\"" Sep 18 03:10:17.155004 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.154981 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457"] Sep 18 03:10:17.283648 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.283609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q2rk\" (UniqueName: \"kubernetes.io/projected/a8a8c92f-7b8b-4ee1-a73b-309531f2cc30-kube-api-access-6q2rk\") pod \"progression-no-metrics-node-0-0-t7457\" (UID: \"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30\") " pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" Sep 18 03:10:17.385089 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.385008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q2rk\" (UniqueName: \"kubernetes.io/projected/a8a8c92f-7b8b-4ee1-a73b-309531f2cc30-kube-api-access-6q2rk\") pod \"progression-no-metrics-node-0-0-t7457\" (UID: \"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30\") " pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" Sep 18 03:10:17.395133 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.395101 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q2rk\" (UniqueName: \"kubernetes.io/projected/a8a8c92f-7b8b-4ee1-a73b-309531f2cc30-kube-api-access-6q2rk\") pod \"progression-no-metrics-node-0-0-t7457\" (UID: \"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30\") " pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" Sep 18 03:10:17.451976 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.451950 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" Sep 18 03:10:17.723060 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:17.722976 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457"] Sep 18 03:10:17.725621 ip-10-0-134-53 kubenswrapper[2575]: W0918 03:10:17.725597 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a8c92f_7b8b_4ee1_a73b_309531f2cc30.slice/crio-4220e2a123054096f39aa3b7b9922415d02601bb7b8d4d08630adb20cb9abadc WatchSource:0}: Error finding container 4220e2a123054096f39aa3b7b9922415d02601bb7b8d4d08630adb20cb9abadc: Status 404 returned error can't find the container with id 4220e2a123054096f39aa3b7b9922415d02601bb7b8d4d08630adb20cb9abadc Sep 18 03:10:18.324524 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:18.324488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" event={"ID":"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30","Type":"ContainerStarted","Data":"e388186ab6b6066ebe31521bc90cbd87568ffa1b0ba4a68d0c145682d2b50827"} Sep 18 03:10:18.324874 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:18.324541 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" event={"ID":"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30","Type":"ContainerStarted","Data":"4220e2a123054096f39aa3b7b9922415d02601bb7b8d4d08630adb20cb9abadc"} Sep 18 03:10:18.344344 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:18.344299 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" podStartSLOduration=1.344283289 podStartE2EDuration="1.344283289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:10:18.343329326 +0000 UTC m=+737.385652739" watchObservedRunningTime="2026-09-18 03:10:18.344283289 +0000 UTC m=+737.386606697" Sep 18 03:10:23.349693 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:23.349652 2575 generic.go:356] "Generic (PLEG): container finished" podID="a8a8c92f-7b8b-4ee1-a73b-309531f2cc30" containerID="e388186ab6b6066ebe31521bc90cbd87568ffa1b0ba4a68d0c145682d2b50827" exitCode=0 Sep 18 03:10:23.350105 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:23.349683 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" event={"ID":"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30","Type":"ContainerDied","Data":"e388186ab6b6066ebe31521bc90cbd87568ffa1b0ba4a68d0c145682d2b50827"} Sep 18 03:10:24.488885 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:24.488858 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" Sep 18 03:10:24.643748 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:24.643641 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q2rk\" (UniqueName: \"kubernetes.io/projected/a8a8c92f-7b8b-4ee1-a73b-309531f2cc30-kube-api-access-6q2rk\") pod \"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30\" (UID: \"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30\") " Sep 18 03:10:24.645770 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:24.645741 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a8c92f-7b8b-4ee1-a73b-309531f2cc30-kube-api-access-6q2rk" (OuterVolumeSpecName: "kube-api-access-6q2rk") pod "a8a8c92f-7b8b-4ee1-a73b-309531f2cc30" (UID: "a8a8c92f-7b8b-4ee1-a73b-309531f2cc30"). InnerVolumeSpecName "kube-api-access-6q2rk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:10:24.744770 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:24.744732 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q2rk\" (UniqueName: \"kubernetes.io/projected/a8a8c92f-7b8b-4ee1-a73b-309531f2cc30-kube-api-access-6q2rk\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:10:25.360003 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:25.359973 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" Sep 18 03:10:25.360003 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:25.359987 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457" event={"ID":"a8a8c92f-7b8b-4ee1-a73b-309531f2cc30","Type":"ContainerDied","Data":"4220e2a123054096f39aa3b7b9922415d02601bb7b8d4d08630adb20cb9abadc"} Sep 18 03:10:25.360219 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:25.360033 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4220e2a123054096f39aa3b7b9922415d02601bb7b8d4d08630adb20cb9abadc" Sep 18 03:10:27.183105 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:27.183080 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:28.010491 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.010460 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xdqxg/must-gather-ngrsq"] Sep 18 03:10:28.010763 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.010752 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a8c92f-7b8b-4ee1-a73b-309531f2cc30" containerName="node" Sep 18 03:10:28.010807 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.010764 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a8c92f-7b8b-4ee1-a73b-309531f2cc30" containerName="node" Sep 18 03:10:28.010841 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.010815 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a8c92f-7b8b-4ee1-a73b-309531f2cc30" containerName="node" Sep 18 03:10:28.012774 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.012759 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:10:28.015152 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.015126 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xdqxg\"/\"default-dockercfg-4tx4c\"" Sep 18 03:10:28.015281 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.015202 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xdqxg\"/\"openshift-service-ca.crt\"" Sep 18 03:10:28.015281 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.015229 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xdqxg\"/\"kube-root-ca.crt\"" Sep 18 03:10:28.021491 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.021470 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdqxg/must-gather-ngrsq"] Sep 18 03:10:28.028081 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.028056 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:28.090925 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.090888 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:28.172300 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.172271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4h6s\" (UniqueName: \"kubernetes.io/projected/04c995d5-7c4a-4ef7-838a-74d805acf4b9-kube-api-access-q4h6s\") pod \"must-gather-ngrsq\" (UID: \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\") " pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:10:28.172459 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.172321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04c995d5-7c4a-4ef7-838a-74d805acf4b9-must-gather-output\") pod \"must-gather-ngrsq\" (UID: \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\") " pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:10:28.273376 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.273312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4h6s\" (UniqueName: \"kubernetes.io/projected/04c995d5-7c4a-4ef7-838a-74d805acf4b9-kube-api-access-q4h6s\") pod \"must-gather-ngrsq\" (UID: \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\") " pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:10:28.273376 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.273370 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04c995d5-7c4a-4ef7-838a-74d805acf4b9-must-gather-output\") pod \"must-gather-ngrsq\" (UID: \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\") " pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:10:28.273755 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.273740 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04c995d5-7c4a-4ef7-838a-74d805acf4b9-must-gather-output\") pod \"must-gather-ngrsq\" (UID: \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\") " pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:10:28.281452 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.281425 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4h6s\" (UniqueName: \"kubernetes.io/projected/04c995d5-7c4a-4ef7-838a-74d805acf4b9-kube-api-access-q4h6s\") pod \"must-gather-ngrsq\" (UID: \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\") " pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:10:28.321715 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.321693 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:10:28.587846 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.587820 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xdqxg/must-gather-ngrsq"] Sep 18 03:10:28.590544 ip-10-0-134-53 kubenswrapper[2575]: W0918 03:10:28.590515 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04c995d5_7c4a_4ef7_838a_74d805acf4b9.slice/crio-6ac62afa655d4bbb59ae368a92bf60271d1442b71da11b11813abdbebc221e8b WatchSource:0}: Error finding container 6ac62afa655d4bbb59ae368a92bf60271d1442b71da11b11813abdbebc221e8b: Status 404 returned error can't find the container with id 6ac62afa655d4bbb59ae368a92bf60271d1442b71da11b11813abdbebc221e8b Sep 18 03:10:28.592384 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:28.592366 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 18 03:10:29.383891 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:29.383803 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" event={"ID":"04c995d5-7c4a-4ef7-838a-74d805acf4b9","Type":"ContainerStarted","Data":"6ac62afa655d4bbb59ae368a92bf60271d1442b71da11b11813abdbebc221e8b"} Sep 18 03:10:32.174952 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.174922 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg"] Sep 18 03:10:32.178669 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.178639 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-f595k/progression-disabled-node-0-0-qhrgg"] Sep 18 03:10:32.184026 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.184000 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl"] Sep 18 03:10:32.187428 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.187386 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-f595k/progression-enabled-node-0-0-78ssl"] Sep 18 03:10:32.192831 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.192809 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49"] Sep 18 03:10:32.198162 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.198140 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-f595k/progression-invalid-node-0-0-jmp49"] Sep 18 03:10:32.214124 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.214100 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457"] Sep 18 03:10:32.221067 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.221021 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-f595k/progression-no-metrics-node-0-0-t7457"] Sep 18 03:10:32.381112 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.381080 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:32.483068 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:32.482926 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:33.145668 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:33.145635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:33.213508 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:33.213482 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39a38874-de46-49c9-b59d-58989476cf54" path="/var/lib/kubelet/pods/39a38874-de46-49c9-b59d-58989476cf54/volumes" Sep 18 03:10:33.213904 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:33.213853 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="445b9734-caf8-4f09-bd93-e86cc23b6512" path="/var/lib/kubelet/pods/445b9734-caf8-4f09-bd93-e86cc23b6512/volumes" Sep 18 03:10:33.214133 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:33.214121 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8a8c92f-7b8b-4ee1-a73b-309531f2cc30" path="/var/lib/kubelet/pods/a8a8c92f-7b8b-4ee1-a73b-309531f2cc30/volumes" Sep 18 03:10:33.214459 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:33.214444 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c21da6cd-113f-4a6b-a70d-12d90356ffb6" path="/var/lib/kubelet/pods/c21da6cd-113f-4a6b-a70d-12d90356ffb6/volumes" Sep 18 03:10:33.247005 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:33.246839 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:10:35.418387 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:35.418340 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" event={"ID":"04c995d5-7c4a-4ef7-838a-74d805acf4b9","Type":"ContainerStarted","Data":"4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944"} Sep 18 03:10:35.418387 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:35.418391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" event={"ID":"04c995d5-7c4a-4ef7-838a-74d805acf4b9","Type":"ContainerStarted","Data":"46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db"} Sep 18 03:10:35.435424 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:10:35.435356 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" podStartSLOduration=2.422069112 podStartE2EDuration="8.435341996s" totalImagesPullingTime="6.013272884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 03:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:10:35.434208815 +0000 UTC m=+754.476532223" watchObservedRunningTime="2026-09-18 03:10:35.435341996 +0000 UTC m=+754.477665404" Sep 18 03:11:20.653950 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:20.653915 2575 generic.go:356] "Generic (PLEG): container finished" podID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerID="46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db" exitCode=0 Sep 18 03:11:20.654369 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:20.653990 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" event={"ID":"04c995d5-7c4a-4ef7-838a-74d805acf4b9","Type":"ContainerDied","Data":"46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db"} Sep 18 03:11:20.654369 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:20.654319 2575 scope.go:117] "RemoveContainer" containerID="46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db" Sep 18 03:11:20.739869 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:20.739847 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xdqxg_must-gather-ngrsq_04c995d5-7c4a-4ef7-838a-74d805acf4b9/gather/0.log" Sep 18 03:11:21.122811 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:21.122774 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:11:21.289732 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:21.289664 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:11:21.388308 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:21.388280 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:11:23.983727 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:23.983701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bd45r_ede2701f-9c64-4a2b-9679-ee282f6106e2/global-pull-secret-syncer/0.log" Sep 18 03:11:24.086571 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:24.086543 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" Sep 18 03:11:24.199537 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:24.199504 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-53.ec2.internal_e8161551427e43bab84dff04d6eaa689/haproxy/0.log" Sep 18 03:11:26.099693 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.099647 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xdqxg/must-gather-ngrsq"] Sep 18 03:11:26.100245 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.099881 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerName="copy" containerID="cri-o://4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944" gracePeriod=2 Sep 18 03:11:26.104741 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.104463 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xdqxg/must-gather-ngrsq"] Sep 18 03:11:26.334296 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.334274 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xdqxg_must-gather-ngrsq_04c995d5-7c4a-4ef7-838a-74d805acf4b9/copy/0.log" Sep 18 03:11:26.336788 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.336770 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:11:26.339149 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:11:26.339125 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ngrsq\" is forbidden: User \"system:node:ip-10-0-134-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xdqxg\": no relationship found between node 'ip-10-0-134-53.ec2.internal' and this object" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:11:26.451364 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.451302 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04c995d5-7c4a-4ef7-838a-74d805acf4b9-must-gather-output\") pod \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\" (UID: \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\") " Sep 18 03:11:26.451518 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.451388 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4h6s\" (UniqueName: \"kubernetes.io/projected/04c995d5-7c4a-4ef7-838a-74d805acf4b9-kube-api-access-q4h6s\") pod \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\" (UID: \"04c995d5-7c4a-4ef7-838a-74d805acf4b9\") " Sep 18 03:11:26.452598 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.452575 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04c995d5-7c4a-4ef7-838a-74d805acf4b9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "04c995d5-7c4a-4ef7-838a-74d805acf4b9" (UID: "04c995d5-7c4a-4ef7-838a-74d805acf4b9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 18 03:11:26.453444 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.453420 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04c995d5-7c4a-4ef7-838a-74d805acf4b9-kube-api-access-q4h6s" (OuterVolumeSpecName: "kube-api-access-q4h6s") pod "04c995d5-7c4a-4ef7-838a-74d805acf4b9" (UID: "04c995d5-7c4a-4ef7-838a-74d805acf4b9"). InnerVolumeSpecName "kube-api-access-q4h6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 18 03:11:26.552682 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.552652 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4h6s\" (UniqueName: \"kubernetes.io/projected/04c995d5-7c4a-4ef7-838a-74d805acf4b9-kube-api-access-q4h6s\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:11:26.552682 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.552679 2575 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04c995d5-7c4a-4ef7-838a-74d805acf4b9-must-gather-output\") on node \"ip-10-0-134-53.ec2.internal\" DevicePath \"\"" Sep 18 03:11:26.682533 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.682507 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xdqxg_must-gather-ngrsq_04c995d5-7c4a-4ef7-838a-74d805acf4b9/copy/0.log" Sep 18 03:11:26.682866 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.682842 2575 generic.go:356] "Generic (PLEG): container finished" podID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerID="4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944" exitCode=143 Sep 18 03:11:26.682958 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.682884 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:11:26.682958 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.682905 2575 scope.go:117] "RemoveContainer" containerID="4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944" Sep 18 03:11:26.685474 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:11:26.685446 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ngrsq\" is forbidden: User \"system:node:ip-10-0-134-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xdqxg\": no relationship found between node 'ip-10-0-134-53.ec2.internal' and this object" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:11:26.691217 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.691200 2575 scope.go:117] "RemoveContainer" containerID="46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db" Sep 18 03:11:26.695322 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:11:26.695299 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-ngrsq\" is forbidden: User \"system:node:ip-10-0-134-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xdqxg\": no relationship found between node 'ip-10-0-134-53.ec2.internal' and this object" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" pod="openshift-must-gather-xdqxg/must-gather-ngrsq" Sep 18 03:11:26.701937 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.701922 2575 scope.go:117] "RemoveContainer" containerID="4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944" Sep 18 03:11:26.702200 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:11:26.702184 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944\": container with ID starting with 4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944 not found: ID does not exist" containerID="4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944" Sep 18 03:11:26.702250 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.702208 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944"} err="failed to get container status \"4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944\": rpc error: code = NotFound desc = could not find container \"4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944\": container with ID starting with 4b152b285de879b4280d78c29482e09790ec50323cbe0cf53862aea030441944 not found: ID does not exist" Sep 18 03:11:26.702250 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.702226 2575 scope.go:117] "RemoveContainer" containerID="46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db" Sep 18 03:11:26.702502 ip-10-0-134-53 kubenswrapper[2575]: E0918 03:11:26.702485 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db\": container with ID starting with 46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db not found: ID does not exist" containerID="46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db" Sep 18 03:11:26.702562 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.702511 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db"} err="failed to get container status \"46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db\": rpc error: code = NotFound desc = could not find container \"46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db\": container with ID starting with 46f19f7a53573a936a5f6126080c26664503f754f8e2272dc35fcb9ede4ed3db not found: ID does not exist" Sep 18 03:11:26.809963 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.809929 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:11:26.868064 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:26.868030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-khsq5_c8dac35d-7edf-4994-b7a9-2e54e4e7f7a4/konnectivity-agent/0.log" limit=1024 Sep 18 03:11:27.212371 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:27.212342 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" path="/var/lib/kubelet/pods/04c995d5-7c4a-4ef7-838a-74d805acf4b9/volumes" Sep 18 03:11:28.015802 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.015721 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ftqxt_c8355db7-5a86-4421-a800-0ecb6569550e/node-exporter/0.log" Sep 18 03:11:28.037904 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.037880 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ftqxt_c8355db7-5a86-4421-a800-0ecb6569550e/kube-rbac-proxy/0.log" Sep 18 03:11:28.063031 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.063006 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ftqxt_c8355db7-5a86-4421-a800-0ecb6569550e/init-textfile/0.log" Sep 18 03:11:28.192969 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.192947 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8d486_10c683f6-c1ca-42a0-ace0-934b53cc0bfa/kube-rbac-proxy-main/0.log" Sep 18 03:11:28.214043 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.214024 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8d486_10c683f6-c1ca-42a0-ace0-934b53cc0bfa/kube-rbac-proxy-self/0.log" Sep 18 03:11:28.241256 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.241237 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8d486_10c683f6-c1ca-42a0-ace0-934b53cc0bfa/openshift-state-metrics/0.log" Sep 18 03:11:28.279053 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.278994 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95c42a57-b0c1-4b35-b225-0449a3fba185/prometheus/0.log" Sep 18 03:11:28.338122 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.338098 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95c42a57-b0c1-4b35-b225-0449a3fba185/config-reloader/0.log" Sep 18 03:11:28.373379 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.373361 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95c42a57-b0c1-4b35-b225-0449a3fba185/thanos-sidecar/0.log" Sep 18 03:11:28.397603 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.397585 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95c42a57-b0c1-4b35-b225-0449a3fba185/kube-rbac-proxy-web/0.log" Sep 18 03:11:28.421282 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.421261 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95c42a57-b0c1-4b35-b225-0449a3fba185/kube-rbac-proxy/0.log" Sep 18 03:11:28.448834 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.448817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95c42a57-b0c1-4b35-b225-0449a3fba185/kube-rbac-proxy-thanos/0.log" Sep 18 03:11:28.472493 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.472473 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95c42a57-b0c1-4b35-b225-0449a3fba185/init-config-reloader/0.log" Sep 18 03:11:28.502058 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.502041 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-gzvgz_07a68a89-2afc-4c9e-b12c-1065f86e9864/prometheus-operator/0.log" Sep 18 03:11:28.523290 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.523275 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-gzvgz_07a68a89-2afc-4c9e-b12c-1065f86e9864/kube-rbac-proxy/0.log" Sep 18 03:11:28.552216 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.552198 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-9tksf_a1b79989-d71d-478e-bce2-1f9d5ebbdbe8/prometheus-operator-admission-webhook/0.log" Sep 18 03:11:28.677449 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.677392 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ff9dbb459-bntsn_4c269926-4464-464b-8e86-b99439af5710/thanos-query/0.log" Sep 18 03:11:28.710445 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.710405 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ff9dbb459-bntsn_4c269926-4464-464b-8e86-b99439af5710/kube-rbac-proxy-web/0.log" Sep 18 03:11:28.733224 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.733206 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ff9dbb459-bntsn_4c269926-4464-464b-8e86-b99439af5710/kube-rbac-proxy/0.log" Sep 18 03:11:28.758483 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.758462 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ff9dbb459-bntsn_4c269926-4464-464b-8e86-b99439af5710/prom-label-proxy/0.log" Sep 18 03:11:28.782643 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.782623 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ff9dbb459-bntsn_4c269926-4464-464b-8e86-b99439af5710/kube-rbac-proxy-rules/0.log" Sep 18 03:11:28.809660 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:28.809606 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5ff9dbb459-bntsn_4c269926-4464-464b-8e86-b99439af5710/kube-rbac-proxy-metrics/0.log" Sep 18 03:11:31.053027 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.052995 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-p7gx9_507ca8a3-229b-414c-891f-facc065ad04b/download-server/0.log" Sep 18 03:11:31.390777 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.390748 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv"] Sep 18 03:11:31.391041 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.391030 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerName="copy" Sep 18 03:11:31.391087 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.391044 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerName="copy" Sep 18 03:11:31.391087 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.391054 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerName="gather" Sep 18 03:11:31.391087 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.391060 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerName="gather" Sep 18 03:11:31.391173 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.391111 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerName="copy" Sep 18 03:11:31.391173 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.391119 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="04c995d5-7c4a-4ef7-838a-74d805acf4b9" containerName="gather" Sep 18 03:11:31.396154 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.396135 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.398590 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.398566 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hthgh\"/\"openshift-service-ca.crt\"" Sep 18 03:11:31.398590 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.398575 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hthgh\"/\"kube-root-ca.crt\"" Sep 18 03:11:31.399470 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.399449 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hthgh\"/\"default-dockercfg-5zltv\"" Sep 18 03:11:31.405860 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.405838 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv"] Sep 18 03:11:31.492282 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.492259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-podres\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.492387 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.492306 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-lib-modules\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.492465 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.492383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr92f\" (UniqueName: \"kubernetes.io/projected/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-kube-api-access-dr92f\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.492465 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.492442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-sys\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.492543 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.492468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-proc\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.593734 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-podres\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.593828 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-lib-modules\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.593828 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr92f\" (UniqueName: \"kubernetes.io/projected/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-kube-api-access-dr92f\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.593828 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-sys\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.593930 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-proc\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.593930 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593870 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-podres\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.593930 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-sys\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.594025 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593945 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-lib-modules\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.594025 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.593994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-proc\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.602591 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.602566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr92f\" (UniqueName: \"kubernetes.io/projected/51327e43-1f4c-45c4-a7ad-340ad4ae0c66-kube-api-access-dr92f\") pod \"perf-node-gather-daemonset-f48kv\" (UID: \"51327e43-1f4c-45c4-a7ad-340ad4ae0c66\") " pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.707454 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.707388 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:31.981359 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:31.981282 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv"] Sep 18 03:11:31.985500 ip-10-0-134-53 kubenswrapper[2575]: W0918 03:11:31.985458 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod51327e43_1f4c_45c4_a7ad_340ad4ae0c66.slice/crio-1f3be26f6fbb00e32eb6010cd8189d19c0f54618a29ae3671769c4abc2e64dd5 WatchSource:0}: Error finding container 1f3be26f6fbb00e32eb6010cd8189d19c0f54618a29ae3671769c4abc2e64dd5: Status 404 returned error can't find the container with id 1f3be26f6fbb00e32eb6010cd8189d19c0f54618a29ae3671769c4abc2e64dd5 Sep 18 03:11:32.471605 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:32.471580 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cm76t_1539f19e-0a38-4da7-857e-157ee37c2367/dns/0.log" Sep 18 03:11:32.498908 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:32.498885 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cm76t_1539f19e-0a38-4da7-857e-157ee37c2367/kube-rbac-proxy/0.log" Sep 18 03:11:32.711889 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:32.711861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" event={"ID":"51327e43-1f4c-45c4-a7ad-340ad4ae0c66","Type":"ContainerStarted","Data":"bb45062a311c84388629b485ad5fd633d4bfef1b2bbcd830df8211baf531a484"} Sep 18 03:11:32.712041 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:32.711904 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" event={"ID":"51327e43-1f4c-45c4-a7ad-340ad4ae0c66","Type":"ContainerStarted","Data":"1f3be26f6fbb00e32eb6010cd8189d19c0f54618a29ae3671769c4abc2e64dd5"} Sep 18 03:11:32.712041 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:32.711972 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:32.727344 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:32.727281 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qsvwf_8f7b1f69-de0d-472c-b7be-22cb32331ca2/dns-node-resolver/0.log" Sep 18 03:11:33.198214 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:33.198191 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5964f9b69b-nljrv_63070dad-3cd7-4ac3-b37a-f5aa30a9b95c/registry/0.log" Sep 18 03:11:33.237933 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:33.237910 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-579bg_b28acd24-e9d1-4daa-8f28-edefbacbda56/node-ca/0.log" Sep 18 03:11:34.460956 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:34.460925 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gpm7w_1922ec46-41f0-481d-9c3a-3d400b2af38d/serve-healthcheck-canary/0.log" Sep 18 03:11:34.984401 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:34.984372 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqxjt_973a9b49-3e8d-49ec-bebb-dc978afdc833/kube-rbac-proxy/0.log" Sep 18 03:11:35.012082 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:35.012062 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqxjt_973a9b49-3e8d-49ec-bebb-dc978afdc833/exporter/0.log" Sep 18 03:11:35.037194 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:35.037170 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqxjt_973a9b49-3e8d-49ec-bebb-dc978afdc833/extractor/0.log" Sep 18 03:11:36.802143 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:36.802113 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-5sm4z_fa3e368c-4bc8-4eee-9894-442f039acd76/jobset-operator/0.log" Sep 18 03:11:38.725989 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:38.725963 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" Sep 18 03:11:38.744195 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:38.744148 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hthgh/perf-node-gather-daemonset-f48kv" podStartSLOduration=7.744131951 podStartE2EDuration="7.744131951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 03:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 03:11:32.73624908 +0000 UTC m=+811.778572488" watchObservedRunningTime="2026-09-18 03:11:38.744131951 +0000 UTC m=+817.786455359" Sep 18 03:11:40.353026 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:40.353001 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-fn475_fdc3ba0d-ccf2-4370-9f47-e39e437455cc/migrator/0.log" Sep 18 03:11:40.378241 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:40.378220 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-fn475_fdc3ba0d-ccf2-4370-9f47-e39e437455cc/graceful-termination/0.log" Sep 18 03:11:42.094631 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.094619 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qrbr8_23215b09-4012-4a2d-b55c-465d0f47d190/kube-multus-additional-cni-plugins/0.log" Sep 18 03:11:42.120000 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.119978 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qrbr8_23215b09-4012-4a2d-b55c-465d0f47d190/egress-router-binary-copy/0.log" Sep 18 03:11:42.146740 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.146709 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qrbr8_23215b09-4012-4a2d-b55c-465d0f47d190/cni-plugins/0.log" Sep 18 03:11:42.174740 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.174721 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qrbr8_23215b09-4012-4a2d-b55c-465d0f47d190/bond-cni-plugin/0.log" Sep 18 03:11:42.197298 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.197283 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qrbr8_23215b09-4012-4a2d-b55c-465d0f47d190/routeoverride-cni/0.log" Sep 18 03:11:42.220960 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.220942 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qrbr8_23215b09-4012-4a2d-b55c-465d0f47d190/whereabouts-cni-bincopy/0.log" Sep 18 03:11:42.243654 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.243634 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qrbr8_23215b09-4012-4a2d-b55c-465d0f47d190/whereabouts-cni/0.log" Sep 18 03:11:42.349643 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.349586 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lmfcw_e8e16660-8e08-42e2-a9ea-24a109e04883/kube-multus/0.log" Sep 18 03:11:42.419854 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.419824 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h2h9j_f815a6e0-6f48-49c4-8e9c-257843eb3eed/network-metrics-daemon/0.log" Sep 18 03:11:42.446169 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:42.446151 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h2h9j_f815a6e0-6f48-49c4-8e9c-257843eb3eed/kube-rbac-proxy/0.log" Sep 18 03:11:43.442083 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.442058 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-controller/0.log" Sep 18 03:11:43.460896 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.460857 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/1.log" Sep 18 03:11:43.461199 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.461163 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovn-acl-logging/0.log" Sep 18 03:11:43.481656 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.481634 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/kube-rbac-proxy-node/0.log" Sep 18 03:11:43.507749 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.507728 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/kube-rbac-proxy-ovn-metrics/0.log" Sep 18 03:11:43.538592 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.538558 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/northd/0.log" Sep 18 03:11:43.568870 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.568847 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/nbdb/0.log" Sep 18 03:11:43.622801 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.622784 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/sbdb/0.log" Sep 18 03:11:43.685223 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:43.685197 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nvdqj_e96cfa56-964e-4765-ae0c-ae2a0984fd92/ovnkube-controller/0.log" Sep 18 03:11:44.916359 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:44.916334 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-h6fj8_efee14b0-15f3-4020-966b-2bb413ea6e4d/network-check-target-container/0.log" Sep 18 03:11:45.893758 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:45.893730 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-d96hd_66104f45-4a8f-419d-b725-7f7ae769a5ed/iptables-alerter/0.log" Sep 18 03:11:46.587892 ip-10-0-134-53 kubenswrapper[2575]: I0918 03:11:46.587863 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-89xww_8e18545b-68c4-4874-a83e-7f6db48b7a5c/tuned/0.log"