Sep 14 09:26:54.931004 ip-10-0-136-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 14 09:26:54.931149 ip-10-0-136-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 14 09:26:54.931245 ip-10-0-136-221 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 14 09:26:54.931910 ip-10-0-136-221 systemd[1]: Failed to start Kubernetes Kubelet. Sep 14 09:27:05.179662 ip-10-0-136-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 14 09:27:05.179683 ip-10-0-136-221 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6221f063b637428d8a67dde3e3323024 -- Sep 14 09:28:41.212751 ip-10-0-136-221 systemd[1]: Starting Kubernetes Kubelet... Sep 14 09:28:41.656030 ip-10-0-136-221 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 14 09:28:41.656030 ip-10-0-136-221 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 14 09:28:41.656030 ip-10-0-136-221 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 14 09:28:41.656030 ip-10-0-136-221 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 14 09:28:41.656030 ip-10-0-136-221 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 14 09:28:41.657228 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.657109 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 14 09:28:41.661553 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661537 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 14 09:28:41.661553 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661553 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661558 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661561 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661564 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661566 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661569 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661572 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661575 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661577 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661586 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661591 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661595 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661599 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661602 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661605 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661608 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661610 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661613 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661615 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 14 09:28:41.661617 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661618 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661620 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661623 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661626 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661629 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661632 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661634 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661637 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661640 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661642 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661645 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661648 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661650 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661653 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661657 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661660 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661663 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661666 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661668 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661670 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 14 09:28:41.662074 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661673 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661676 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661679 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661682 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661685 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661687 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661689 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661692 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661694 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661696 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661699 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661702 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661704 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661707 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661710 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661713 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661716 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661718 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661721 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 14 09:28:41.662616 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661723 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661725 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661728 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661731 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661734 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661737 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661739 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661741 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661744 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661746 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661749 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661752 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661754 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661757 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661759 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661761 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661764 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661766 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661769 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661771 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 14 09:28:41.663166 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661773 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661776 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661778 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661781 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661783 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661785 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661788 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661792 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661795 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661797 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661800 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661802 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661805 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661807 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661809 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661814 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661817 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661820 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661823 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 14 09:28:41.663673 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.661826 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 14 09:28:41.665186 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665167 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 14 09:28:41.665186 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665182 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 14 09:28:41.665186 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665186 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 14 09:28:41.665186 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665190 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 14 09:28:41.665186 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665193 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665197 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665200 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665203 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665208 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665211 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665215 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665217 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665220 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665225 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665230 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665233 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665235 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665240 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665243 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665247 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665250 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665252 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665257 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 14 09:28:41.665378 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665259 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665262 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665264 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665267 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665269 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665272 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665274 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665277 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665284 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665287 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665290 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665292 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665295 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665297 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665300 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665303 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665306 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665309 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665312 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665314 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 14 09:28:41.665877 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665317 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665319 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665322 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665325 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665328 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665330 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665333 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665335 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665338 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665340 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665344 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665348 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665351 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665355 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665357 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665360 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665362 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665365 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665368 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665371 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 14 09:28:41.666422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665373 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665376 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665379 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665382 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665384 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665387 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665390 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665394 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665396 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665399 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665401 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665404 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665406 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665409 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665412 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665415 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665417 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665420 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665423 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665440 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 14 09:28:41.666935 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665447 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665450 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665454 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665458 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665461 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665463 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665466 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665469 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665471 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665474 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665476 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665479 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665481 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665484 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665486 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665489 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665921 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665928 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665931 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 14 09:28:41.667422 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665935 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665938 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665942 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665945 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665948 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665951 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665954 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665957 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665959 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665962 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665965 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665968 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665971 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665974 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665978 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665981 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665984 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665988 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 14 09:28:41.667902 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665992 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665994 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.665997 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666000 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666002 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666004 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666007 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666010 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666012 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666014 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666017 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666020 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666024 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666027 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666031 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666034 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666037 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666039 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666042 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666044 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 14 09:28:41.668337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666047 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666049 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666051 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666054 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666056 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666058 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666061 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666063 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666066 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666068 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666071 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666073 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666076 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666078 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666081 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666083 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666086 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666088 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666090 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 14 09:28:41.668829 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666093 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666095 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666098 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666100 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666102 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666105 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666108 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666111 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666114 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666116 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666119 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666121 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666124 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666126 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666129 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666131 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666133 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666136 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666138 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666142 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 14 09:28:41.669288 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666144 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666155 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666159 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666162 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666164 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666167 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666169 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666172 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666174 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666177 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666179 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666182 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666185 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666187 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666190 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666192 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666195 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666198 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666200 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666270 2559 flags.go:64] FLAG: --address="0.0.0.0" Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666304 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 14 09:28:41.669784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666310 2559 flags.go:64] FLAG: --anonymous-auth="true" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666315 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666319 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666322 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666326 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666330 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666333 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666336 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666340 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666343 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666346 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666349 2559 flags.go:64] FLAG: --cgroup-root="" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666352 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666355 2559 flags.go:64] FLAG: --client-ca-file="" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666359 2559 flags.go:64] FLAG: --cloud-provider="external" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666362 2559 flags.go:64] FLAG: --cluster-dns="[]" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666366 2559 flags.go:64] FLAG: --cluster-domain="" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666369 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666373 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666376 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666379 2559 flags.go:64] FLAG: --container-log-max-files="5" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666387 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666390 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 14 09:28:41.670299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666393 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666396 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666399 2559 flags.go:64] FLAG: --contention-profiling="false" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666403 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666405 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666409 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666411 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666419 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666422 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666425 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666446 2559 flags.go:64] FLAG: --enable-load-reader="false" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666450 2559 flags.go:64] FLAG: --enable-server="true" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666453 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666458 2559 flags.go:64] FLAG: --event-burst="100" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666461 2559 flags.go:64] FLAG: --event-qps="50" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666463 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666466 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666469 2559 flags.go:64] FLAG: --eviction-hard="" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666473 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666476 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666478 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666481 2559 flags.go:64] FLAG: --eviction-soft="" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666484 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666487 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666491 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 14 09:28:41.670871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666494 2559 flags.go:64] FLAG: --experimental-mounter-path="" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666497 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666501 2559 flags.go:64] FLAG: --fail-swap-on="true" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666504 2559 flags.go:64] FLAG: --feature-gates="" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666512 2559 flags.go:64] FLAG: --file-check-frequency="20s" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666515 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666518 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666521 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666524 2559 flags.go:64] FLAG: --healthz-port="10248" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666527 2559 flags.go:64] FLAG: --help="false" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666530 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-136-221.ec2.internal" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666533 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666536 2559 flags.go:64] FLAG: --http-check-frequency="20s" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666539 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666544 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666547 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666550 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666553 2559 flags.go:64] FLAG: --image-service-endpoint="" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666555 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666558 2559 flags.go:64] FLAG: --kube-api-burst="100" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666561 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666564 2559 flags.go:64] FLAG: --kube-api-qps="50" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666566 2559 flags.go:64] FLAG: --kube-reserved="" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666569 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 14 09:28:41.671565 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666572 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666575 2559 flags.go:64] FLAG: --kubelet-cgroups="" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666577 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666580 2559 flags.go:64] FLAG: --lock-file="" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666583 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666586 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666590 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666596 2559 flags.go:64] FLAG: --log-json-split-stream="false" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666599 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666602 2559 flags.go:64] FLAG: --log-text-split-stream="false" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666604 2559 flags.go:64] FLAG: --logging-format="text" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666607 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666610 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666613 2559 flags.go:64] FLAG: --manifest-url="" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666616 2559 flags.go:64] FLAG: --manifest-url-header="" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666620 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666623 2559 flags.go:64] FLAG: --max-open-files="1000000" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666627 2559 flags.go:64] FLAG: --max-pods="110" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666630 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666632 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666635 2559 flags.go:64] FLAG: --memory-manager-policy="None" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666638 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666646 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666649 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666652 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 14 09:28:41.672146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666659 2559 flags.go:64] FLAG: --node-status-max-images="50" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666662 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666665 2559 flags.go:64] FLAG: --oom-score-adj="-999" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666668 2559 flags.go:64] FLAG: --pod-cidr="" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666671 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666677 2559 flags.go:64] FLAG: --pod-manifest-path="" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666680 2559 flags.go:64] FLAG: --pod-max-pids="-1" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666683 2559 flags.go:64] FLAG: --pods-per-core="0" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666686 2559 flags.go:64] FLAG: --port="10250" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666689 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666692 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0254eadf703d5ca04" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666695 2559 flags.go:64] FLAG: --qos-reserved="" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666698 2559 flags.go:64] FLAG: --read-only-port="10255" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666701 2559 flags.go:64] FLAG: --register-node="true" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666706 2559 flags.go:64] FLAG: --register-with-taints="" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666709 2559 flags.go:64] FLAG: --registry-burst="10" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666713 2559 flags.go:64] FLAG: --registry-qps="5" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666716 2559 flags.go:64] FLAG: --reserved-cpus="" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666719 2559 flags.go:64] FLAG: --reserved-memory="" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666722 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666725 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666728 2559 flags.go:64] FLAG: --rotate-certificates="false" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666731 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666734 2559 flags.go:64] FLAG: --runonce="false" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666736 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 14 09:28:41.672795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666739 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666742 2559 flags.go:64] FLAG: --seccomp-default="false" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666745 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666748 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666752 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666755 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666758 2559 flags.go:64] FLAG: --storage-driver-password="root" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666760 2559 flags.go:64] FLAG: --storage-driver-secure="false" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666763 2559 flags.go:64] FLAG: --storage-driver-table="stats" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666766 2559 flags.go:64] FLAG: --storage-driver-user="root" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666769 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666772 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666775 2559 flags.go:64] FLAG: --system-cgroups="" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666777 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666782 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666785 2559 flags.go:64] FLAG: --tls-cert-file="" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666788 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666792 2559 flags.go:64] FLAG: --tls-min-version="" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666795 2559 flags.go:64] FLAG: --tls-private-key-file="" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666798 2559 flags.go:64] FLAG: --topology-manager-policy="none" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666800 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666805 2559 flags.go:64] FLAG: --topology-manager-scope="container" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666808 2559 flags.go:64] FLAG: --v="2" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666811 2559 flags.go:64] FLAG: --version="false" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666816 2559 flags.go:64] FLAG: --vmodule="" Sep 14 09:28:41.673409 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666819 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.666823 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666941 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666944 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666948 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666951 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666954 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666957 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666960 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666963 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666966 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666970 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666973 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666975 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666978 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666982 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666986 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666989 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666991 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666994 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 14 09:28:41.674027 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.666997 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667000 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667002 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667005 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667007 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667010 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667012 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667014 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667018 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667020 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667023 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667025 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667028 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667030 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667033 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667035 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667037 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667040 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667042 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667045 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 14 09:28:41.674554 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667047 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667050 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667053 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667057 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667059 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667062 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667064 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667067 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667069 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667071 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667074 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667077 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667079 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667081 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667084 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667086 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667089 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667092 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667094 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667097 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 14 09:28:41.675095 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667099 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667102 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667106 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667109 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667112 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667115 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667119 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667122 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667124 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667126 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667129 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667132 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667134 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667137 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667139 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667144 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667146 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667149 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667152 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667154 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 14 09:28:41.675612 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667157 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667159 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667162 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667164 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667167 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667169 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667172 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667174 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667177 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667179 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667182 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667184 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667187 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667189 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667192 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667194 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667196 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667200 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667205 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 14 09:28:41.676107 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667209 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 14 09:28:41.676609 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.667211 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 14 09:28:41.676609 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.667980 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 14 09:28:41.676609 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.676225 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 14 09:28:41.676609 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.676355 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 14 09:28:41.677295 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.677284 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 14 09:28:41.677326 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.677295 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 14 09:28:41.677365 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677357 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 14 09:28:41.677365 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677365 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677370 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677374 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677378 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677381 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677384 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677387 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677390 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677393 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677395 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677398 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677401 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677404 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677407 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677410 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677414 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677417 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677420 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677423 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 14 09:28:41.677423 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677438 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677441 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677444 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677447 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677450 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677453 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677456 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677458 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677461 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677464 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677467 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677471 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677474 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677477 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677479 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677483 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677485 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677488 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677491 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677493 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 14 09:28:41.677905 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677496 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677499 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677501 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677503 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677506 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677508 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677511 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677513 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677516 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677519 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677521 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677524 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677526 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677529 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677532 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677535 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677538 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677540 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677543 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 14 09:28:41.678399 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677545 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677548 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677550 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677553 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677556 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677558 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677561 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677563 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677566 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677568 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677570 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677573 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677575 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677577 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677580 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677582 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677585 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677588 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677590 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677593 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 14 09:28:41.678876 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677596 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677598 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677601 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677604 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677606 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677609 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677611 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677614 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677616 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677619 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677621 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677624 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677626 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677628 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677631 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677633 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677636 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677639 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677641 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 14 09:28:41.679371 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677643 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.677648 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677792 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677797 2559 feature_gate.go:328] unrecognized feature gate: Example2 Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677800 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677804 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677808 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677812 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677815 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677818 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677821 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677824 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677827 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677830 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 14 09:28:41.679839 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677832 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677835 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677838 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677840 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677843 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677847 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677850 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677853 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677855 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677858 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677860 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677863 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677865 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677867 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677870 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677872 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677875 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677879 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677882 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 14 09:28:41.680183 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677885 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677888 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677890 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677893 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677895 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677897 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677900 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677902 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677905 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677907 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677910 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677913 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677915 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677918 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677921 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677923 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677926 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677928 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677931 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677933 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 14 09:28:41.680705 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677936 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677938 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677941 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677943 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677946 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677948 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677951 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677953 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677955 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677958 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677961 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677963 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677965 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677968 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677970 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677972 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677975 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677978 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677980 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 14 09:28:41.681235 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677982 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677985 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677987 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677991 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677993 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677996 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.677998 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678001 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678004 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678006 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678008 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678011 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678013 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678015 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678018 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678020 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678023 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678025 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678027 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678030 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 14 09:28:41.681722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678032 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678035 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678037 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678039 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678042 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678044 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678047 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678049 2559 feature_gate.go:328] unrecognized feature gate: Example Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:41.678052 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.678056 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.678181 2559 server.go:962] "Client rotation is on, will bootstrap in background" Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.680561 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.681590 2559 server.go:1019] "Starting client certificate rotation" Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.681688 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 14 09:28:41.682254 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.681727 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 14 09:28:41.684607 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.684458 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 14 09:28:41.685616 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.685598 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 14 09:28:41.699019 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.698995 2559 log.go:25] "Validated CRI v1 runtime API" Sep 14 09:28:41.702279 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.702257 2559 log.go:25] "Validated CRI v1 image API" Sep 14 09:28:41.703179 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.703163 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 14 09:28:41.707379 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.707357 2559 fs.go:135] Filesystem UUIDs: map[038e0dfe-38d8-4bb2-a7eb-65b3c242b6d5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a92f3083-aca4-43f1-bc03-2f5ff0600a77:/dev/nvme0n1p4] Sep 14 09:28:41.707453 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.707379 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 14 09:28:41.710418 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.710401 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 14 09:28:41.713732 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.713613 2559 manager.go:216] Machine: {Timestamp:2026-09-14 09:28:41.712176381 +0000 UTC m=+0.380751472 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100596 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24a6ecbf79a4a68dadc1400867458b SystemUUID:ec24a6ec-bf79-a4a6-8dad-c1400867458b BootID:6221f063-b637-428d-8a67-dde3e3323024 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:e0:2b:48:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:e0:2b:48:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:00:f1:df:88:e0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 14 09:28:41.713732 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.713726 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 14 09:28:41.713881 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.713864 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 14 09:28:41.717729 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.717701 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 14 09:28:41.717879 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.717731 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 14 09:28:41.718645 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.718615 2559 topology_manager.go:138] "Creating topology manager with none policy" Sep 14 09:28:41.718678 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.718649 2559 container_manager_linux.go:309] "Creating device plugin manager" Sep 14 09:28:41.718678 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.718656 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 14 09:28:41.718678 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.718670 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 14 09:28:41.719758 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.719748 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 14 09:28:41.724840 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.724825 2559 state_mem.go:36] "Initialized new in-memory state store" Sep 14 09:28:41.724977 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.724967 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 14 09:28:41.725020 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.724998 2559 kubelet.go:486] "Attempting to sync node with API server" Sep 14 09:28:41.725020 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.725009 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 14 09:28:41.725090 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.725025 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 14 09:28:41.725090 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.725034 2559 kubelet.go:398] "Adding apiserver pod source" Sep 14 09:28:41.725090 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.725042 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 14 09:28:41.725536 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.725524 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 14 09:28:41.725571 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.725545 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 14 09:28:41.727976 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.727949 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 14 09:28:41.729251 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.729224 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78p84" Sep 14 09:28:41.731009 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.730992 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 14 09:28:41.731097 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.731030 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 14 09:28:41.733010 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.732995 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 14 09:28:41.733080 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733016 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 14 09:28:41.733080 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733025 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 14 09:28:41.733080 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733033 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 14 09:28:41.733080 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733045 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 14 09:28:41.733080 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733054 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 14 09:28:41.733080 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733075 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 14 09:28:41.733281 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733085 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 14 09:28:41.733281 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733096 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 14 09:28:41.733281 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733105 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 14 09:28:41.733281 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733117 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 14 09:28:41.733281 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.733126 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 14 09:28:41.733627 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.733608 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 14 09:28:41.733663 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.733608 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 14 09:28:41.734081 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.734070 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 14 09:28:41.734128 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.734085 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 14 09:28:41.737518 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.737501 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78p84" Sep 14 09:28:41.739054 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.739039 2559 server.go:1268] "Started kubelet" Sep 14 09:28:41.740027 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.739987 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 14 09:28:41.740893 ip-10-0-136-221 systemd[1]: Started Kubernetes Kubelet. Sep 14 09:28:41.742938 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.742669 2559 server.go:310] "Adding debug handlers to kubelet server" Sep 14 09:28:41.743354 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.743289 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 14 09:28:41.743473 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.743377 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 14 09:28:41.746592 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.746573 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 14 09:28:41.746821 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.746801 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 14 09:28:41.747486 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.747423 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 14 09:28:41.751006 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.750991 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 14 09:28:41.751642 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.751629 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 14 09:28:41.751772 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.751754 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:41.752455 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.752419 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 14 09:28:41.752516 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.752457 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 14 09:28:41.752606 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.752418 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 14 09:28:41.752606 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.752571 2559 reconstruct.go:97] "Volume reconstruction finished" Sep 14 09:28:41.752606 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.752579 2559 reconciler.go:29] "Reconciler: start to sync state" Sep 14 09:28:41.753143 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.753129 2559 factory.go:55] Registering systemd factory Sep 14 09:28:41.753203 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.753147 2559 factory.go:223] Registration of the systemd container factory successfully Sep 14 09:28:41.753386 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.753372 2559 factory.go:153] Registering CRI-O factory Sep 14 09:28:41.753468 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.753390 2559 factory.go:223] Registration of the crio container factory successfully Sep 14 09:28:41.753468 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.753462 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 14 09:28:41.753570 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.753481 2559 factory.go:103] Registering Raw factory Sep 14 09:28:41.753570 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.753496 2559 manager.go:1196] Started watching for new ooms in manager Sep 14 09:28:41.753883 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.753865 2559 manager.go:349] Starting recovery of all containers Sep 14 09:28:41.764054 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.764030 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 14 09:28:41.764364 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.764344 2559 manager.go:354] Recovery completed Sep 14 09:28:41.765948 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.765929 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-221.ec2.internal\" not found" node="ip-10-0-136-221.ec2.internal" Sep 14 09:28:41.768545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.768532 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 14 09:28:41.771061 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.771043 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientMemory" Sep 14 09:28:41.771132 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.771073 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasNoDiskPressure" Sep 14 09:28:41.771132 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.771086 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientPID" Sep 14 09:28:41.771626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.771611 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 14 09:28:41.771626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.771623 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 14 09:28:41.771721 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.771626 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 14 09:28:41.771721 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.771644 2559 state_mem.go:36] "Initialized new in-memory state store" Sep 14 09:28:41.772327 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.772310 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientMemory" Sep 14 09:28:41.772379 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.772343 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasNoDiskPressure" Sep 14 09:28:41.772379 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.772354 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientPID" Sep 14 09:28:41.773850 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.773836 2559 policy_none.go:49] "None policy: Start" Sep 14 09:28:41.773893 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.773857 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 14 09:28:41.773893 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.773870 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 14 09:28:41.775998 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.775985 2559 policy_none.go:47] "Start" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.816729 2559 manager.go:337] "Starting Device Plugin manager" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.816778 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.816791 2559 server.go:87] "Starting device plugin registration server" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.817097 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.817110 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.817198 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.817277 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.817287 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.817854 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 14 09:28:41.829137 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.817896 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:41.870999 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.870963 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 14 09:28:41.872316 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.872289 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 14 09:28:41.872425 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.872339 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 14 09:28:41.872425 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.872368 2559 kubelet.go:2448] "Starting kubelet main sync loop" Sep 14 09:28:41.872425 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.872412 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 14 09:28:41.874259 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.874241 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 14 09:28:41.917737 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.917617 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 14 09:28:41.918655 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.918640 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientMemory" Sep 14 09:28:41.918732 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.918673 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasNoDiskPressure" Sep 14 09:28:41.918732 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.918686 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientPID" Sep 14 09:28:41.918732 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.918712 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-221.ec2.internal" Sep 14 09:28:41.927320 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.927303 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-221.ec2.internal" Sep 14 09:28:41.927370 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.927329 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-221.ec2.internal\": node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:41.936360 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:41.936330 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:41.973031 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.972991 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal"] Sep 14 09:28:41.973129 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.973090 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 14 09:28:41.974660 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.974637 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientMemory" Sep 14 09:28:41.974772 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.974671 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasNoDiskPressure" Sep 14 09:28:41.974772 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.974682 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientPID" Sep 14 09:28:41.976826 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.976811 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 14 09:28:41.976939 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.976923 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:41.976997 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.976953 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 14 09:28:41.977597 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.977583 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientMemory" Sep 14 09:28:41.977687 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.977602 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientMemory" Sep 14 09:28:41.977687 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.977622 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasNoDiskPressure" Sep 14 09:28:41.977687 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.977631 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientPID" Sep 14 09:28:41.977687 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.977606 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasNoDiskPressure" Sep 14 09:28:41.977858 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.977692 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientPID" Sep 14 09:28:41.979681 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.979667 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" Sep 14 09:28:41.979732 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.979692 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 14 09:28:41.980344 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.980330 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientMemory" Sep 14 09:28:41.980412 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.980357 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasNoDiskPressure" Sep 14 09:28:41.980412 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:41.980370 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeHasSufficientPID" Sep 14 09:28:42.006329 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.006297 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-221.ec2.internal\" not found" node="ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.010654 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.010636 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-221.ec2.internal\" not found" node="ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.036981 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.036945 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.054542 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.054513 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e8d91d2b5ed7cd579e77961dd0af861-config\") pod \"kube-apiserver-proxy-ip-10-0-136-221.ec2.internal\" (UID: \"5e8d91d2b5ed7cd579e77961dd0af861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.054542 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.054543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af51293b69240bbfcb1f110e1ee48cce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal\" (UID: \"af51293b69240bbfcb1f110e1ee48cce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.054699 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.054561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af51293b69240bbfcb1f110e1ee48cce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal\" (UID: \"af51293b69240bbfcb1f110e1ee48cce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.137277 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.137236 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.155631 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.155605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af51293b69240bbfcb1f110e1ee48cce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal\" (UID: \"af51293b69240bbfcb1f110e1ee48cce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.155734 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.155643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af51293b69240bbfcb1f110e1ee48cce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal\" (UID: \"af51293b69240bbfcb1f110e1ee48cce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.155734 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.155662 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e8d91d2b5ed7cd579e77961dd0af861-config\") pod \"kube-apiserver-proxy-ip-10-0-136-221.ec2.internal\" (UID: \"5e8d91d2b5ed7cd579e77961dd0af861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.155832 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.155741 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af51293b69240bbfcb1f110e1ee48cce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal\" (UID: \"af51293b69240bbfcb1f110e1ee48cce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.155832 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.155786 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af51293b69240bbfcb1f110e1ee48cce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal\" (UID: \"af51293b69240bbfcb1f110e1ee48cce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.155832 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.155750 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5e8d91d2b5ed7cd579e77961dd0af861-config\") pod \"kube-apiserver-proxy-ip-10-0-136-221.ec2.internal\" (UID: \"5e8d91d2b5ed7cd579e77961dd0af861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.238099 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.238024 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.308586 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.308555 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.313417 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.313248 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" Sep 14 09:28:42.338583 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.338552 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.439139 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.439080 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.539758 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.539692 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.640268 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.640220 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.681801 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.681773 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 14 09:28:42.682246 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.681943 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 14 09:28:42.682246 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.681967 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 14 09:28:42.741284 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.741251 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.747420 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.747386 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-13 09:23:41 +0000 UTC" deadline="2028-03-13 23:13:02.358379158 +0000 UTC" Sep 14 09:28:42.747513 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.747422 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13117h44m19.610961766s" Sep 14 09:28:42.841926 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.841901 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.942757 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:42.942722 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:42.963552 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:42.963514 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8d91d2b5ed7cd579e77961dd0af861.slice/crio-4249eba06f01b2ee42a81c8a63d8adf5c694ca3a4c6c66c95598139a67d8b7fa WatchSource:0}: Error finding container 4249eba06f01b2ee42a81c8a63d8adf5c694ca3a4c6c66c95598139a67d8b7fa: Status 404 returned error can't find the container with id 4249eba06f01b2ee42a81c8a63d8adf5c694ca3a4c6c66c95598139a67d8b7fa Sep 14 09:28:42.963792 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:42.963771 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf51293b69240bbfcb1f110e1ee48cce.slice/crio-8f06be42d5d51125c8b0ec6acc592f2facc5775db344710322cd1bade6c12128 WatchSource:0}: Error finding container 8f06be42d5d51125c8b0ec6acc592f2facc5775db344710322cd1bade6c12128: Status 404 returned error can't find the container with id 8f06be42d5d51125c8b0ec6acc592f2facc5775db344710322cd1bade6c12128 Sep 14 09:28:42.968222 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:42.968206 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 14 09:28:43.043724 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.043693 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-221.ec2.internal\" not found" Sep 14 09:28:43.131031 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.130958 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 14 09:28:43.152926 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.152895 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" Sep 14 09:28:43.162778 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.162758 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 14 09:28:43.164573 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.164560 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" Sep 14 09:28:43.173505 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.173490 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 14 09:28:43.268417 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.268394 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 14 09:28:43.514217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.514137 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 14 09:28:43.727240 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.727202 2559 apiserver.go:52] "Watching apiserver" Sep 14 09:28:43.734639 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.734612 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 14 09:28:43.736494 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.736468 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-gqqz4","openshift-multus/network-metrics-daemon-lk56x","openshift-network-operator/iptables-alerter-4vrxv","openshift-ovn-kubernetes/ovnkube-node-sf76n","kube-system/global-pull-secret-syncer-5q4qs","kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527","openshift-cluster-node-tuning-operator/tuned-cbltt","openshift-dns/node-resolver-q5zms","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal","openshift-multus/multus-additional-cni-plugins-b92d4","openshift-network-diagnostics/network-check-target-vdwm6","kube-system/konnectivity-agent-bjgbf","openshift-image-registry/node-ca-mlfkj"] Sep 14 09:28:43.739034 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.739004 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.741353 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.741324 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 14 09:28:43.741483 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.741374 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 14 09:28:43.744804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.741671 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 14 09:28:43.744804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.741867 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wts9f\"" Sep 14 09:28:43.744804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.742446 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:28:43.744804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.744406 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.744804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.744545 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 14 09:28:43.744804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.744614 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 14 09:28:43.744804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.744636 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2gbbh\"" Sep 14 09:28:43.747664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.746463 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 14 09:28:43.747664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.746469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.747664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.746902 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dtlmm\"" Sep 14 09:28:43.747664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.747202 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 14 09:28:43.747664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.747513 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 14 09:28:43.748724 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.748486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.748724 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.748549 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:43.748724 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.748578 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 14 09:28:43.748905 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.748766 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r4w9q\"" Sep 14 09:28:43.749029 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.749013 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 14 09:28:43.749029 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.749028 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 14 09:28:43.749164 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.749016 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 14 09:28:43.749985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.749970 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 14 09:28:43.750183 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.750170 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 14 09:28:43.751600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.750594 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.751725 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.751701 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 14 09:28:43.752763 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.752370 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 14 09:28:43.752763 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.752623 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 14 09:28:43.752906 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.752781 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 14 09:28:43.752906 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.752796 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qzbrs\"" Sep 14 09:28:43.752906 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.752840 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.755773 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.755756 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-htqxw\"" Sep 14 09:28:43.756317 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.756299 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 14 09:28:43.756461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.756413 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 14 09:28:43.756527 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.756500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.761662 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.758988 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sstjs\"" Sep 14 09:28:43.761662 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.758996 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 14 09:28:43.761662 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.759204 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 14 09:28:43.761662 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.759326 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 14 09:28:43.761662 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.759352 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 14 09:28:43.761662 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.760103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:43.761662 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.760185 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:43.763028 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.762591 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.764488 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.764447 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 14 09:28:43.764841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.764825 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ndk4k\"" Sep 14 09:28:43.764990 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.764968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-slash\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765041 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-systemd\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765041 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-cni-netd\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765097 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765049 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 14 09:28:43.765097 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-kubelet-config\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.765149 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.765149 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6d8c6e2-08af-49bd-8210-88043e13a1ca-host\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.765215 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/480e2d27-bdf3-4ddf-8015-60e0fe5e18ec-agent-certs\") pod \"konnectivity-agent-bjgbf\" (UID: \"480e2d27-bdf3-4ddf-8015-60e0fe5e18ec\") " pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:28:43.765215 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765171 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-kubelet\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765215 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765207 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovnkube-script-lib\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765289 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-dbus\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.765289 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-var-lib-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765289 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srknl\" (UniqueName: \"kubernetes.io/projected/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-kube-api-access-srknl\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.765387 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7924245-a333-4304-b7e7-a322600d7b6a-cni-binary-copy\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765387 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-cni-multus\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765387 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-kubelet\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765387 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-multus-certs\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765387 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765377 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/480e2d27-bdf3-4ddf-8015-60e0fe5e18ec-konnectivity-ca\") pod \"konnectivity-agent-bjgbf\" (UID: \"480e2d27-bdf3-4ddf-8015-60e0fe5e18ec\") " pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:28:43.765600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-run-netns\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765414 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-node-log\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvpkg\" (UniqueName: \"kubernetes.io/projected/88029567-4bab-4780-b61d-1c9eacbb1ab3-kube-api-access-hvpkg\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.765600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-host-slash\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.765600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765531 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-hosts-file\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.765600 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-cnibin\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765601 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovn-node-metrics-cert\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765632 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-socket-dir-parent\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6xlx\" (UniqueName: \"kubernetes.io/projected/b813202e-5b2b-4392-b192-8be9eecc2c64-kube-api-access-k6xlx\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765697 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6d8c6e2-08af-49bd-8210-88043e13a1ca-serviceca\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-conf-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-sys-fs\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-etc-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-cni-bin\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovnkube-config\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765829 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-k8s-cni-cncf-io\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-netns\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-cni-bin\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c7924245-a333-4304-b7e7-a322600d7b6a-multus-daemon-config\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-etc-kubernetes\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.765985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-iptables-alerter-script\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765953 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-hostroot\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765975 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6rkf\" (UniqueName: \"kubernetes.io/projected/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-kube-api-access-h6rkf\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.765995 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-ovn\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-env-overrides\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766037 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-log-socket\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-device-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-tmp-dir\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-cni-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq69g\" (UniqueName: \"kubernetes.io/projected/c7924245-a333-4304-b7e7-a322600d7b6a-kube-api-access-xq69g\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-registration-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-systemd-units\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfkm2\" (UniqueName: \"kubernetes.io/projected/d6d8c6e2-08af-49bd-8210-88043e13a1ca-kube-api-access-tfkm2\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-socket-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-etc-selinux\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-system-cni-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766282 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 14 09:28:43.766708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.766298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-run-ovn-kubernetes\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.767743 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.767555 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 14 09:28:43.767888 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.767855 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:43.767931 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.767918 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:28:43.768089 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.768078 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-42df6\"" Sep 14 09:28:43.768186 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.768168 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 14 09:28:43.787560 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.787538 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jq2n2" Sep 14 09:28:43.794923 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.794892 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jq2n2" Sep 14 09:28:43.853423 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.853394 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 14 09:28:43.866517 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866493 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-conf-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.866517 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-sys-fs\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-kubernetes\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-etc-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-cni-bin\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866620 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovnkube-config\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866630 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-sys-fs\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-k8s-cni-cncf-io\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866630 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-conf-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-netns\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866677 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-etc-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866726 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-netns\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-cni-bin\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.866745 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866727 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-cni-bin\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.867287 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866755 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-k8s-cni-cncf-io\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.867287 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866784 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c7924245-a333-4304-b7e7-a322600d7b6a-multus-daemon-config\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.867287 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-etc-kubernetes\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.867287 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866851 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-cni-bin\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.867287 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-iptables-alerter-script\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.867287 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.866894 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-etc-kubernetes\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867308 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovnkube-config\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867339 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c7924245-a333-4304-b7e7-a322600d7b6a-multus-daemon-config\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867395 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-iptables-alerter-script\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-hostroot\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysconfig\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54q7z\" (UniqueName: \"kubernetes.io/projected/d72021a1-6fdb-459b-8b69-008184061dea-kube-api-access-54q7z\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6rkf\" (UniqueName: \"kubernetes.io/projected/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-kube-api-access-h6rkf\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-ovn\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867553 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-hostroot\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-env-overrides\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867596 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-ovn\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.867626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867612 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-log-socket\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-device-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867645 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-log-socket\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867659 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-tmp-dir\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-cni-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867692 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-device-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq69g\" (UniqueName: \"kubernetes.io/projected/c7924245-a333-4304-b7e7-a322600d7b6a-kube-api-access-xq69g\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867725 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-registration-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867747 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-systemd-units\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867775 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysctl-d\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfkm2\" (UniqueName: \"kubernetes.io/projected/d6d8c6e2-08af-49bd-8210-88043e13a1ca-kube-api-access-tfkm2\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-run\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867834 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867855 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-socket-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-etc-selinux\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-system-cni-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysctl-conf\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.868115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867927 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-tmp-dir\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cnibin\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867937 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-env-overrides\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.867969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cni-binary-copy\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-run-ovn-kubernetes\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868009 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-registration-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-slash\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868040 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-slash\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-systemd\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868056 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-cni-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-cni-netd\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868082 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-run-ovn-kubernetes\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-kubelet-config\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868113 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-system-cni-dir\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868126 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-kubelet-config\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868170 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-socket-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.868784 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-etc-selinux\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868022 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-systemd-units\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868211 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-systemd\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868254 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-cni-netd\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.868246 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868281 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6d8c6e2-08af-49bd-8210-88043e13a1ca-host\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-systemd\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868333 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6d8c6e2-08af-49bd-8210-88043e13a1ca-host\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/480e2d27-bdf3-4ddf-8015-60e0fe5e18ec-agent-certs\") pod \"konnectivity-agent-bjgbf\" (UID: \"480e2d27-bdf3-4ddf-8015-60e0fe5e18ec\") " pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.868410 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret podName:18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e nodeName:}" failed. No retries permitted until 2026-09-14 09:28:44.36838753 +0000 UTC m=+3.036962621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret") pod "global-pull-secret-syncer-5q4qs" (UID: "18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e") : object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868452 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-kubelet\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovnkube-script-lib\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868480 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-kubelet\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-dbus\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-host\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-tuned\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868578 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-dbus\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:43.869545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-var-lib-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868791 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-var-lib-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srknl\" (UniqueName: \"kubernetes.io/projected/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-kube-api-access-srknl\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7924245-a333-4304-b7e7-a322600d7b6a-cni-binary-copy\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868900 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovnkube-script-lib\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.868942 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-cni-multus\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.869413 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.869491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-kubelet\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.869626 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-cni-multus\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.869726 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-var-lib-kubelet\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.869903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-multus-certs\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.869945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/480e2d27-bdf3-4ddf-8015-60e0fe5e18ec-konnectivity-ca\") pod \"konnectivity-agent-bjgbf\" (UID: \"480e2d27-bdf3-4ddf-8015-60e0fe5e18ec\") " pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.869971 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-run-netns\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.869972 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c7924245-a333-4304-b7e7-a322600d7b6a-cni-binary-copy\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870018 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870034 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-run-netns\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870036 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-host-run-multus-certs\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-var-lib-kubelet\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870100 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-tmp\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870158 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-node-log\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvpkg\" (UniqueName: \"kubernetes.io/projected/88029567-4bab-4780-b61d-1c9eacbb1ab3-kube-api-access-hvpkg\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870201 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870229 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-node-log\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-host-slash\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-hosts-file\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870300 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b813202e-5b2b-4392-b192-8be9eecc2c64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-cnibin\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870365 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-host-slash\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870373 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-hosts-file\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870419 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-modprobe-d\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870418 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-cnibin\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhsl\" (UniqueName: \"kubernetes.io/projected/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-kube-api-access-qnhsl\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.870992 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870530 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovn-node-metrics-cert\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-socket-dir-parent\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-sys\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870599 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/480e2d27-bdf3-4ddf-8015-60e0fe5e18ec-konnectivity-ca\") pod \"konnectivity-agent-bjgbf\" (UID: \"480e2d27-bdf3-4ddf-8015-60e0fe5e18ec\") " pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-lib-modules\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4drd6\" (UniqueName: \"kubernetes.io/projected/d1c18c8f-f775-4ace-84dd-3e46e453e8de-kube-api-access-4drd6\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870683 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c7924245-a333-4304-b7e7-a322600d7b6a-multus-socket-dir-parent\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6xlx\" (UniqueName: \"kubernetes.io/projected/b813202e-5b2b-4392-b192-8be9eecc2c64-kube-api-access-k6xlx\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.870996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-system-cni-dir\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.871046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.871120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6d8c6e2-08af-49bd-8210-88043e13a1ca-serviceca\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.871518 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88029567-4bab-4780-b61d-1c9eacbb1ab3-run-openvswitch\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.871690 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.871550 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6d8c6e2-08af-49bd-8210-88043e13a1ca-serviceca\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.875945 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.875908 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88029567-4bab-4780-b61d-1c9eacbb1ab3-ovn-node-metrics-cert\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.875945 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.875950 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/480e2d27-bdf3-4ddf-8015-60e0fe5e18ec-agent-certs\") pod \"konnectivity-agent-bjgbf\" (UID: \"480e2d27-bdf3-4ddf-8015-60e0fe5e18ec\") " pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:28:43.876989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.876966 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6rkf\" (UniqueName: \"kubernetes.io/projected/1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb-kube-api-access-h6rkf\") pod \"iptables-alerter-4vrxv\" (UID: \"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb\") " pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:43.879005 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.878962 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq69g\" (UniqueName: \"kubernetes.io/projected/c7924245-a333-4304-b7e7-a322600d7b6a-kube-api-access-xq69g\") pod \"multus-gqqz4\" (UID: \"c7924245-a333-4304-b7e7-a322600d7b6a\") " pod="openshift-multus/multus-gqqz4" Sep 14 09:28:43.879550 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.879505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" event={"ID":"af51293b69240bbfcb1f110e1ee48cce","Type":"ContainerStarted","Data":"8f06be42d5d51125c8b0ec6acc592f2facc5775db344710322cd1bade6c12128"} Sep 14 09:28:43.879963 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.879924 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfkm2\" (UniqueName: \"kubernetes.io/projected/d6d8c6e2-08af-49bd-8210-88043e13a1ca-kube-api-access-tfkm2\") pod \"node-ca-mlfkj\" (UID: \"d6d8c6e2-08af-49bd-8210-88043e13a1ca\") " pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:43.881090 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.880995 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" event={"ID":"5e8d91d2b5ed7cd579e77961dd0af861","Type":"ContainerStarted","Data":"4249eba06f01b2ee42a81c8a63d8adf5c694ca3a4c6c66c95598139a67d8b7fa"} Sep 14 09:28:43.883301 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.883277 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srknl\" (UniqueName: \"kubernetes.io/projected/b85043e0-817d-4fb1-b67b-e5ce2a50adb1-kube-api-access-srknl\") pod \"node-resolver-q5zms\" (UID: \"b85043e0-817d-4fb1-b67b-e5ce2a50adb1\") " pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:43.883566 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.883545 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6xlx\" (UniqueName: \"kubernetes.io/projected/b813202e-5b2b-4392-b192-8be9eecc2c64-kube-api-access-k6xlx\") pod \"aws-ebs-csi-driver-node-9j527\" (UID: \"b813202e-5b2b-4392-b192-8be9eecc2c64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:43.884282 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.884252 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvpkg\" (UniqueName: \"kubernetes.io/projected/88029567-4bab-4780-b61d-1c9eacbb1ab3-kube-api-access-hvpkg\") pod \"ovnkube-node-sf76n\" (UID: \"88029567-4bab-4780-b61d-1c9eacbb1ab3\") " pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:43.899518 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.899490 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 14 09:28:43.972310 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972277 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhsl\" (UniqueName: \"kubernetes.io/projected/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-kube-api-access-qnhsl\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-sys\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-lib-modules\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4drd6\" (UniqueName: \"kubernetes.io/projected/d1c18c8f-f775-4ace-84dd-3e46e453e8de-kube-api-access-4drd6\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.972500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-system-cni-dir\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.972500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972401 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-sys\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.972500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-kubernetes\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysconfig\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972536 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54q7z\" (UniqueName: \"kubernetes.io/projected/d72021a1-6fdb-459b-8b69-008184061dea-kube-api-access-54q7z\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972586 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysctl-d\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-run\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972692 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysctl-conf\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972701 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-kubernetes\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cnibin\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cni-binary-copy\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972769 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-systemd\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-host\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972818 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-lib-modules\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.972841 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-tuned\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972906 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-var-lib-kubelet\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-tmp\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-modprobe-d\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972955 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973019 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-system-cni-dir\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973068 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-modprobe-d\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.973085 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973113 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-var-lib-kubelet\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.973147 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs podName:d72021a1-6fdb-459b-8b69-008184061dea nodeName:}" failed. No retries permitted until 2026-09-14 09:28:44.473119582 +0000 UTC m=+3.141694714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs") pod "network-metrics-daemon-lk56x" (UID: "d72021a1-6fdb-459b-8b69-008184061dea") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973168 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.973461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973189 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-run\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.974217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973531 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysctl-conf\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.974217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.972667 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysconfig\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.974217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973588 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cnibin\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.974217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973600 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-systemd\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.974217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973590 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cni-binary-copy\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.974217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-host\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.974217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.973728 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-sysctl-d\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.974217 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.974043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1c18c8f-f775-4ace-84dd-3e46e453e8de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:43.975640 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.975623 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-tmp\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.975734 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.975653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-etc-tuned\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.979401 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.979142 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 14 09:28:43.979401 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.979162 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 14 09:28:43.979401 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.979174 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9ptf5 for pod openshift-network-diagnostics/network-check-target-vdwm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:43.979401 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:43.979234 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5 podName:f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0 nodeName:}" failed. No retries permitted until 2026-09-14 09:28:44.479206175 +0000 UTC m=+3.147781271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9ptf5" (UniqueName: "kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5") pod "network-check-target-vdwm6" (UID: "f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:43.981521 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.981497 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhsl\" (UniqueName: \"kubernetes.io/projected/7caf8f0f-d4cb-4801-ba41-cc17611aee3f-kube-api-access-qnhsl\") pod \"tuned-cbltt\" (UID: \"7caf8f0f-d4cb-4801-ba41-cc17611aee3f\") " pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:43.981853 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.981832 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54q7z\" (UniqueName: \"kubernetes.io/projected/d72021a1-6fdb-459b-8b69-008184061dea-kube-api-access-54q7z\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:43.982075 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:43.982054 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4drd6\" (UniqueName: \"kubernetes.io/projected/d1c18c8f-f775-4ace-84dd-3e46e453e8de-kube-api-access-4drd6\") pod \"multus-additional-cni-plugins-b92d4\" (UID: \"d1c18c8f-f775-4ace-84dd-3e46e453e8de\") " pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:44.055500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.055410 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" Sep 14 09:28:44.066837 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.066808 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:28:44.077462 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.077421 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4vrxv" Sep 14 09:28:44.081898 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.081879 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:28:44.089408 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.089389 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mlfkj" Sep 14 09:28:44.095923 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.095905 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q5zms" Sep 14 09:28:44.108385 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.108361 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqqz4" Sep 14 09:28:44.115975 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.115957 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cbltt" Sep 14 09:28:44.121488 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.121470 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b92d4" Sep 14 09:28:44.376187 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.376125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:44.376321 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.376301 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:44.376386 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.376376 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret podName:18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e nodeName:}" failed. No retries permitted until 2026-09-14 09:28:45.376357639 +0000 UTC m=+4.044932729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret") pod "global-pull-secret-syncer-5q4qs" (UID: "18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e") : object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:44.477020 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.476990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:44.477165 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.477149 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:44.477288 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.477266 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs podName:d72021a1-6fdb-459b-8b69-008184061dea nodeName:}" failed. No retries permitted until 2026-09-14 09:28:45.477245797 +0000 UTC m=+4.145820876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs") pod "network-metrics-daemon-lk56x" (UID: "d72021a1-6fdb-459b-8b69-008184061dea") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:44.577524 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.577491 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:44.577677 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.577625 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 14 09:28:44.577677 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.577639 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 14 09:28:44.577677 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.577647 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9ptf5 for pod openshift-network-diagnostics/network-check-target-vdwm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:44.577794 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.577689 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5 podName:f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0 nodeName:}" failed. No retries permitted until 2026-09-14 09:28:45.577676836 +0000 UTC m=+4.246251917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ptf5" (UniqueName: "kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5") pod "network-check-target-vdwm6" (UID: "f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:44.725928 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.725904 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480e2d27_bdf3_4ddf_8015_60e0fe5e18ec.slice/crio-a85e5e2df4d1c31ef21f0d75fcb86c19321d8f08a0096c0ff7aa09d83041fbf7 WatchSource:0}: Error finding container a85e5e2df4d1c31ef21f0d75fcb86c19321d8f08a0096c0ff7aa09d83041fbf7: Status 404 returned error can't find the container with id a85e5e2df4d1c31ef21f0d75fcb86c19321d8f08a0096c0ff7aa09d83041fbf7 Sep 14 09:28:44.726724 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.726694 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85043e0_817d_4fb1_b67b_e5ce2a50adb1.slice/crio-317ceb5e4b25e1097b1347d78a450af0a4f77dfa712ddc7fe6ea0b081b332432 WatchSource:0}: Error finding container 317ceb5e4b25e1097b1347d78a450af0a4f77dfa712ddc7fe6ea0b081b332432: Status 404 returned error can't find the container with id 317ceb5e4b25e1097b1347d78a450af0a4f77dfa712ddc7fe6ea0b081b332432 Sep 14 09:28:44.727499 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.727463 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb813202e_5b2b_4392_b192_8be9eecc2c64.slice/crio-d3bfabe5e31f0dc50ccefc8936e5715f98bc6a3cef1d22a6e8a06841b3ae926e WatchSource:0}: Error finding container d3bfabe5e31f0dc50ccefc8936e5715f98bc6a3cef1d22a6e8a06841b3ae926e: Status 404 returned error can't find the container with id d3bfabe5e31f0dc50ccefc8936e5715f98bc6a3cef1d22a6e8a06841b3ae926e Sep 14 09:28:44.729810 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.729793 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7caf8f0f_d4cb_4801_ba41_cc17611aee3f.slice/crio-02e0e251b8f948d47c6fcac41f5561909865cef132d76e1586673ff739d0df05 WatchSource:0}: Error finding container 02e0e251b8f948d47c6fcac41f5561909865cef132d76e1586673ff739d0df05: Status 404 returned error can't find the container with id 02e0e251b8f948d47c6fcac41f5561909865cef132d76e1586673ff739d0df05 Sep 14 09:28:44.731085 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.731046 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d8c6e2_08af_49bd_8210_88043e13a1ca.slice/crio-d911b737abfa7106dd20b3250ccbed3470a288ab189c6d29b3c0a770f8ed219d WatchSource:0}: Error finding container d911b737abfa7106dd20b3250ccbed3470a288ab189c6d29b3c0a770f8ed219d: Status 404 returned error can't find the container with id d911b737abfa7106dd20b3250ccbed3470a288ab189c6d29b3c0a770f8ed219d Sep 14 09:28:44.731736 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.731640 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88029567_4bab_4780_b61d_1c9eacbb1ab3.slice/crio-5e5cbf9b2348e3f81be7c17ff3350e9eca7b5f406258dfbdcc2734b760a3cd8a WatchSource:0}: Error finding container 5e5cbf9b2348e3f81be7c17ff3350e9eca7b5f406258dfbdcc2734b760a3cd8a: Status 404 returned error can't find the container with id 5e5cbf9b2348e3f81be7c17ff3350e9eca7b5f406258dfbdcc2734b760a3cd8a Sep 14 09:28:44.733239 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.733130 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7924245_a333_4304_b7e7_a322600d7b6a.slice/crio-95e8b59e070461b098e1f3baaac9514a9fd95a13f75bfcfd954f14e52c439299 WatchSource:0}: Error finding container 95e8b59e070461b098e1f3baaac9514a9fd95a13f75bfcfd954f14e52c439299: Status 404 returned error can't find the container with id 95e8b59e070461b098e1f3baaac9514a9fd95a13f75bfcfd954f14e52c439299 Sep 14 09:28:44.733722 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.733654 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c18c8f_f775_4ace_84dd_3e46e453e8de.slice/crio-ed7f84b7b42b063cf6044003c7fe43ca396792a17e785946ae56320464b574d1 WatchSource:0}: Error finding container ed7f84b7b42b063cf6044003c7fe43ca396792a17e785946ae56320464b574d1: Status 404 returned error can't find the container with id ed7f84b7b42b063cf6044003c7fe43ca396792a17e785946ae56320464b574d1 Sep 14 09:28:44.735103 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:28:44.735084 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd2d5cd_e5a4_4b88_9fe7_5b7281845acb.slice/crio-78c9af249e5e760c6f7121c65519b331a4220d37de269966c921f1e639ede78a WatchSource:0}: Error finding container 78c9af249e5e760c6f7121c65519b331a4220d37de269966c921f1e639ede78a: Status 404 returned error can't find the container with id 78c9af249e5e760c6f7121c65519b331a4220d37de269966c921f1e639ede78a Sep 14 09:28:44.798174 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.798122 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 09:23:43 +0000 UTC" deadline="2028-02-12 05:04:39.505659356 +0000 UTC" Sep 14 09:28:44.798174 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.798170 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12379h35m54.707491656s" Sep 14 09:28:44.872797 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.872770 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:44.872932 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.872863 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:44.872932 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.872909 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:44.873070 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:44.873028 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:44.887302 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.887270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" event={"ID":"5e8d91d2b5ed7cd579e77961dd0af861","Type":"ContainerStarted","Data":"575daf3f4067fb9b2b112fae50815b46c287fbd52f2df85ff93ca34a9f759a82"} Sep 14 09:28:44.888492 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.888463 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mlfkj" event={"ID":"d6d8c6e2-08af-49bd-8210-88043e13a1ca","Type":"ContainerStarted","Data":"d911b737abfa7106dd20b3250ccbed3470a288ab189c6d29b3c0a770f8ed219d"} Sep 14 09:28:44.889581 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.889556 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b92d4" event={"ID":"d1c18c8f-f775-4ace-84dd-3e46e453e8de","Type":"ContainerStarted","Data":"ed7f84b7b42b063cf6044003c7fe43ca396792a17e785946ae56320464b574d1"} Sep 14 09:28:44.890485 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.890463 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqqz4" event={"ID":"c7924245-a333-4304-b7e7-a322600d7b6a","Type":"ContainerStarted","Data":"95e8b59e070461b098e1f3baaac9514a9fd95a13f75bfcfd954f14e52c439299"} Sep 14 09:28:44.892113 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.892095 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"5e5cbf9b2348e3f81be7c17ff3350e9eca7b5f406258dfbdcc2734b760a3cd8a"} Sep 14 09:28:44.894301 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.894283 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bjgbf" event={"ID":"480e2d27-bdf3-4ddf-8015-60e0fe5e18ec","Type":"ContainerStarted","Data":"a85e5e2df4d1c31ef21f0d75fcb86c19321d8f08a0096c0ff7aa09d83041fbf7"} Sep 14 09:28:44.896867 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.896847 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vrxv" event={"ID":"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb","Type":"ContainerStarted","Data":"78c9af249e5e760c6f7121c65519b331a4220d37de269966c921f1e639ede78a"} Sep 14 09:28:44.897966 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.897946 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cbltt" event={"ID":"7caf8f0f-d4cb-4801-ba41-cc17611aee3f","Type":"ContainerStarted","Data":"02e0e251b8f948d47c6fcac41f5561909865cef132d76e1586673ff739d0df05"} Sep 14 09:28:44.899213 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.899180 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-221.ec2.internal" podStartSLOduration=2.899169666 podStartE2EDuration="2.899169666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:28:44.899118012 +0000 UTC m=+3.567693109" watchObservedRunningTime="2026-09-14 09:28:44.899169666 +0000 UTC m=+3.567744764" Sep 14 09:28:44.899288 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.899253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" event={"ID":"b813202e-5b2b-4392-b192-8be9eecc2c64","Type":"ContainerStarted","Data":"d3bfabe5e31f0dc50ccefc8936e5715f98bc6a3cef1d22a6e8a06841b3ae926e"} Sep 14 09:28:44.900852 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:44.900835 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q5zms" event={"ID":"b85043e0-817d-4fb1-b67b-e5ce2a50adb1","Type":"ContainerStarted","Data":"317ceb5e4b25e1097b1347d78a450af0a4f77dfa712ddc7fe6ea0b081b332432"} Sep 14 09:28:45.383629 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:45.383588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:45.383799 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.383734 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:45.383799 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.383790 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret podName:18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e nodeName:}" failed. No retries permitted until 2026-09-14 09:28:47.383774133 +0000 UTC m=+6.052349215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret") pod "global-pull-secret-syncer-5q4qs" (UID: "18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e") : object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:45.484136 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:45.484100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:45.484303 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.484231 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:45.484303 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.484291 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs podName:d72021a1-6fdb-459b-8b69-008184061dea nodeName:}" failed. No retries permitted until 2026-09-14 09:28:47.48427327 +0000 UTC m=+6.152848351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs") pod "network-metrics-daemon-lk56x" (UID: "d72021a1-6fdb-459b-8b69-008184061dea") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:45.585446 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:45.585060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:45.585446 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.585238 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 14 09:28:45.585446 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.585258 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 14 09:28:45.585446 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.585270 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9ptf5 for pod openshift-network-diagnostics/network-check-target-vdwm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:45.585446 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.585325 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5 podName:f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0 nodeName:}" failed. No retries permitted until 2026-09-14 09:28:47.585309022 +0000 UTC m=+6.253884109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ptf5" (UniqueName: "kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5") pod "network-check-target-vdwm6" (UID: "f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:45.798568 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:45.798522 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 09:23:43 +0000 UTC" deadline="2028-03-11 05:31:45.222968165 +0000 UTC" Sep 14 09:28:45.798568 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:45.798561 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13052h2m59.424412078s" Sep 14 09:28:45.875556 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:45.874489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:45.875556 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:45.874614 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:28:45.926987 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:45.926383 2559 generic.go:356] "Generic (PLEG): container finished" podID="af51293b69240bbfcb1f110e1ee48cce" containerID="2170dbda083d43c92f54f086ae6c736feaa7053fef8bfc1f920ecb8f79dcdef8" exitCode=0 Sep 14 09:28:45.927342 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:45.927321 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" event={"ID":"af51293b69240bbfcb1f110e1ee48cce","Type":"ContainerDied","Data":"2170dbda083d43c92f54f086ae6c736feaa7053fef8bfc1f920ecb8f79dcdef8"} Sep 14 09:28:46.873814 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:46.873553 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:46.874274 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:46.873947 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:46.874346 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:46.873767 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:46.874455 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:46.874414 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:46.957522 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:46.957483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" event={"ID":"af51293b69240bbfcb1f110e1ee48cce","Type":"ContainerStarted","Data":"3f21f43e432bb30a31868cda4610d47587c5952d69dfbbbbdb3fa37119ac7e1a"} Sep 14 09:28:47.402527 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:47.401875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:47.402527 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.402101 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:47.402527 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.402161 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret podName:18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e nodeName:}" failed. No retries permitted until 2026-09-14 09:28:51.402143675 +0000 UTC m=+10.070718759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret") pod "global-pull-secret-syncer-5q4qs" (UID: "18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e") : object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:47.503400 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:47.502806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:47.503400 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.503003 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:47.503400 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.503070 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs podName:d72021a1-6fdb-459b-8b69-008184061dea nodeName:}" failed. No retries permitted until 2026-09-14 09:28:51.503051095 +0000 UTC m=+10.171626188 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs") pod "network-metrics-daemon-lk56x" (UID: "d72021a1-6fdb-459b-8b69-008184061dea") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:47.603771 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:47.603733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:47.603956 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.603921 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 14 09:28:47.603956 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.603941 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 14 09:28:47.603956 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.603952 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9ptf5 for pod openshift-network-diagnostics/network-check-target-vdwm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:47.604099 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.604012 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5 podName:f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0 nodeName:}" failed. No retries permitted until 2026-09-14 09:28:51.60399261 +0000 UTC m=+10.272568233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ptf5" (UniqueName: "kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5") pod "network-check-target-vdwm6" (UID: "f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:47.875301 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:47.874745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:47.875301 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:47.874883 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:28:48.873230 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:48.873189 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:48.873418 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:48.873330 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:48.873756 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:48.873736 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:48.873848 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:48.873828 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:49.873251 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:49.873219 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:49.873732 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:49.873365 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:28:50.873542 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:50.873507 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:50.874005 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:50.873646 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:50.874005 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:50.873726 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:50.874005 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:50.873784 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:51.434576 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:51.434503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:51.434758 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.434649 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:51.434758 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.434713 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret podName:18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e nodeName:}" failed. No retries permitted until 2026-09-14 09:28:59.434694958 +0000 UTC m=+18.103270057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret") pod "global-pull-secret-syncer-5q4qs" (UID: "18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e") : object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:51.534877 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:51.534841 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:51.535088 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.534965 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:51.535088 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.535014 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs podName:d72021a1-6fdb-459b-8b69-008184061dea nodeName:}" failed. No retries permitted until 2026-09-14 09:28:59.53500166 +0000 UTC m=+18.203576739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs") pod "network-metrics-daemon-lk56x" (UID: "d72021a1-6fdb-459b-8b69-008184061dea") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:51.636007 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:51.635953 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:51.636165 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.636092 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 14 09:28:51.636165 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.636106 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 14 09:28:51.636165 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.636116 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9ptf5 for pod openshift-network-diagnostics/network-check-target-vdwm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:51.636335 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.636169 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5 podName:f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0 nodeName:}" failed. No retries permitted until 2026-09-14 09:28:59.636153572 +0000 UTC m=+18.304728651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ptf5" (UniqueName: "kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5") pod "network-check-target-vdwm6" (UID: "f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:51.874413 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:51.873880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:51.874413 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:51.874012 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:28:52.873121 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:52.872975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:52.873121 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:52.873010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:52.873121 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:52.873121 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:52.873422 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:52.873214 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:53.872958 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:53.872931 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:53.873352 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:53.873038 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:28:54.873021 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:54.872981 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:54.873501 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:54.873124 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:54.873501 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:54.873187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:54.873501 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:54.873312 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:55.873061 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:55.873020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:55.873587 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:55.873146 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:28:56.873566 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:56.873530 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:56.874004 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:56.873528 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:56.874004 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:56.873676 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:56.874004 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:56.873754 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:57.873564 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:57.873532 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:57.873749 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:57.873635 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:28:58.872998 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:58.872959 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:58.873283 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:58.872964 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:58.873283 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:58.873102 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:28:58.873283 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:58.873171 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:28:59.495525 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:59.495485 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:28:59.495972 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.495666 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:59.495972 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.495751 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret podName:18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e nodeName:}" failed. No retries permitted until 2026-09-14 09:29:15.495728363 +0000 UTC m=+34.164303456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret") pod "global-pull-secret-syncer-5q4qs" (UID: "18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e") : object "kube-system"/"original-pull-secret" not registered Sep 14 09:28:59.596090 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:59.596037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:28:59.596280 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.596192 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:59.596280 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.596279 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs podName:d72021a1-6fdb-459b-8b69-008184061dea nodeName:}" failed. No retries permitted until 2026-09-14 09:29:15.596256812 +0000 UTC m=+34.264831904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs") pod "network-metrics-daemon-lk56x" (UID: "d72021a1-6fdb-459b-8b69-008184061dea") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:28:59.696677 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:59.696637 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:59.696876 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.696839 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 14 09:28:59.696876 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.696861 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 14 09:28:59.696876 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.696875 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9ptf5 for pod openshift-network-diagnostics/network-check-target-vdwm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:59.697030 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.696951 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5 podName:f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:15.696932247 +0000 UTC m=+34.365507349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ptf5" (UniqueName: "kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5") pod "network-check-target-vdwm6" (UID: "f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:28:59.873215 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:28:59.873136 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:28:59.873379 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:28:59.873245 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:00.873631 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:00.873594 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:00.873631 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:00.873621 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:00.874147 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:00.873733 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:00.874147 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:00.873836 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:29:01.874214 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:01.874176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:01.874702 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:01.874278 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:02.872968 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:02.872926 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:02.872968 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:02.872974 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:02.873170 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:02.873059 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:29:02.873209 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:02.873176 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:03.873064 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:03.873031 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:03.874164 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:03.873172 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:03.997087 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:03.996987 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cbltt" event={"ID":"7caf8f0f-d4cb-4801-ba41-cc17611aee3f","Type":"ContainerStarted","Data":"4d2704844e4d278fe2027af59166a9e4b4630c55211ebdb3a0475ef36748adf5"} Sep 14 09:29:03.998869 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:03.998839 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" event={"ID":"b813202e-5b2b-4392-b192-8be9eecc2c64","Type":"ContainerStarted","Data":"62a1acaef2c871e5213be90d53f2ce5352c5813ece0fb119d590820ee36ac4bf"} Sep 14 09:29:04.001127 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.001091 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q5zms" event={"ID":"b85043e0-817d-4fb1-b67b-e5ce2a50adb1","Type":"ContainerStarted","Data":"b651e8d46635c7e9900bd4838d21ba32dd0a6ff97a8d03347ae28767bc192b5f"} Sep 14 09:29:04.002812 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.002786 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mlfkj" event={"ID":"d6d8c6e2-08af-49bd-8210-88043e13a1ca","Type":"ContainerStarted","Data":"cdf1ac620271f01a9028baf8fd80577e03f7c1bd2fa5fc071ce56141f4f3e988"} Sep 14 09:29:04.004479 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.004452 2559 generic.go:356] "Generic (PLEG): container finished" podID="d1c18c8f-f775-4ace-84dd-3e46e453e8de" containerID="92186335ab0f373f838ef2c9cde40dd504973f0f2f080ef57befbce2d8802197" exitCode=0 Sep 14 09:29:04.004590 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.004535 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b92d4" event={"ID":"d1c18c8f-f775-4ace-84dd-3e46e453e8de","Type":"ContainerDied","Data":"92186335ab0f373f838ef2c9cde40dd504973f0f2f080ef57befbce2d8802197"} Sep 14 09:29:04.006326 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.006287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqqz4" event={"ID":"c7924245-a333-4304-b7e7-a322600d7b6a","Type":"ContainerStarted","Data":"c7e3b1369d5e8a80b75e2f774e4e5b372c84bde6e95d717d6dd1da4501ce95c1"} Sep 14 09:29:04.010165 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.010144 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"f6a5d27a7559113a4b7887fb7556b24e964f8ce12d6f638c85f93b17cf508f51"} Sep 14 09:29:04.010255 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.010213 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"c5b59db22f80e5b691a31db244527d01a2a5b9c61f40c26bced84fa8684f5820"} Sep 14 09:29:04.010255 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.010244 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"2c2c3a605ce2a3a8b7ca518fce7ebe5765a0c08a25464e967e67160b6a011430"} Sep 14 09:29:04.010327 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.010272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"3a9f5bfaef37686ea98dadc6056b74e4fc919f977b6c494f7251a3784798607d"} Sep 14 09:29:04.010327 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.010299 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"bb30cb2c0ef4679aacb6978127b18b311c619d8c5565689ebcc7bfed875cdd33"} Sep 14 09:29:04.010393 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.010338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"7f27b9b660083bc2d956d7ec6fe95af5b6b616443b919c0e1d336a8dde223805"} Sep 14 09:29:04.012034 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.012014 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bjgbf" event={"ID":"480e2d27-bdf3-4ddf-8015-60e0fe5e18ec","Type":"ContainerStarted","Data":"05ce7095cc52814fe56aaa3ef48adc962e18589d71c4934433655545002dd181"} Sep 14 09:29:04.013959 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.013920 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cbltt" podStartSLOduration=4.6979522110000005 podStartE2EDuration="23.013906383s" totalImagesPullingTime="18.315954172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:04.01348614 +0000 UTC m=+22.682061241" watchObservedRunningTime="2026-09-14 09:29:04.013906383 +0000 UTC m=+22.682481483" Sep 14 09:29:04.014113 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.014086 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-221.ec2.internal" podStartSLOduration=22.014077405 podStartE2EDuration="22.014077405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:28:46.973814749 +0000 UTC m=+5.642389851" watchObservedRunningTime="2026-09-14 09:29:04.014077405 +0000 UTC m=+22.682652507" Sep 14 09:29:04.031327 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.031224 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gqqz4" podStartSLOduration=4.67925752 podStartE2EDuration="23.031203932s" totalImagesPullingTime="18.351946412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:04.030112493 +0000 UTC m=+22.698687576" watchObservedRunningTime="2026-09-14 09:29:04.031203932 +0000 UTC m=+22.699779034" Sep 14 09:29:04.063268 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.063219 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bjgbf" podStartSLOduration=12.264405925 podStartE2EDuration="23.063203046s" totalImagesPullingTime="10.798797121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:04.063026205 +0000 UTC m=+22.731601307" watchObservedRunningTime="2026-09-14 09:29:04.063203046 +0000 UTC m=+22.731778145" Sep 14 09:29:04.079759 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.079699 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q5zms" podStartSLOduration=4.779623935 podStartE2EDuration="23.079677723s" totalImagesPullingTime="18.300053788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:04.078908599 +0000 UTC m=+22.747483700" watchObservedRunningTime="2026-09-14 09:29:04.079677723 +0000 UTC m=+22.748252825" Sep 14 09:29:04.093216 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.093148 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mlfkj" podStartSLOduration=4.798105513 podStartE2EDuration="23.093126595s" totalImagesPullingTime="18.295021082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:04.093018189 +0000 UTC m=+22.761593292" watchObservedRunningTime="2026-09-14 09:29:04.093126595 +0000 UTC m=+22.761701707" Sep 14 09:29:04.476942 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.476790 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 14 09:29:04.833245 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.833106 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-14T09:29:04.476935154Z","UUID":"14b70023-0345-498b-aa35-9b2fa5cb0399","Handler":null,"Name":"","Endpoint":""} Sep 14 09:29:04.834654 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.834631 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 14 09:29:04.834767 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.834667 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 14 09:29:04.873137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.873099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:04.873628 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:04.873099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:04.873628 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:04.873230 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:29:04.873628 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:04.873281 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:05.017229 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:05.017192 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" event={"ID":"b813202e-5b2b-4392-b192-8be9eecc2c64","Type":"ContainerStarted","Data":"db9076923d9e944a3e7daf582b1190b6bdc936556b06cce05b9d9d8e0123e17b"} Sep 14 09:29:05.019008 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:05.018976 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4vrxv" event={"ID":"1bd2d5cd-e5a4-4b88-9fe7-5b7281845acb","Type":"ContainerStarted","Data":"19ad26be859ded4a83d05c535b4336812a34d8592bba17b42035e29734c04b95"} Sep 14 09:29:05.876657 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:05.876598 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:05.876997 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:05.876701 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:05.876997 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:05.876964 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:05.877082 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:05.877066 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:06.025602 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:06.025014 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" event={"ID":"b813202e-5b2b-4392-b192-8be9eecc2c64","Type":"ContainerStarted","Data":"3e46c9011d0a05a2fa6fc1fa6c4733f216622a9df57ec473fad71db784bee125"} Sep 14 09:29:06.029346 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:06.029251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"3a1176e195bccbccc0a2602bb7de1a661ddbc96582f535a49e294d4dd8bc4b39"} Sep 14 09:29:06.042072 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:06.042009 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4vrxv" podStartSLOduration=6.75030129 podStartE2EDuration="25.041986755s" totalImagesPullingTime="18.291685465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:05.037236457 +0000 UTC m=+23.705811890" watchObservedRunningTime="2026-09-14 09:29:06.041986755 +0000 UTC m=+24.710561860" Sep 14 09:29:06.042304 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:06.042281 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9j527" podStartSLOduration=4.382998155 podStartE2EDuration="25.042273123s" totalImagesPullingTime="20.659274968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:06.041561782 +0000 UTC m=+24.710136893" watchObservedRunningTime="2026-09-14 09:29:06.042273123 +0000 UTC m=+24.710848223" Sep 14 09:29:06.873075 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:06.873035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:06.873272 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:06.873163 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:29:07.314161 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:07.314090 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:29:07.314801 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:07.314782 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:29:07.873327 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:07.873292 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:07.873327 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:07.873321 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:07.873606 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:07.873421 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:07.873606 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:07.873532 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:08.035145 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:08.035113 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:29:08.035662 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:08.035629 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bjgbf" Sep 14 09:29:08.873639 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:08.873455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:08.874328 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:08.873744 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:29:09.041264 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.041164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" event={"ID":"88029567-4bab-4780-b61d-1c9eacbb1ab3","Type":"ContainerStarted","Data":"58775e69659b3847bbd9011b7074471e0e20eee974619abb3fa125d5e454696d"} Sep 14 09:29:09.041450 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.041408 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:29:09.041512 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.041493 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:29:09.043081 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.043056 2559 generic.go:356] "Generic (PLEG): container finished" podID="d1c18c8f-f775-4ace-84dd-3e46e453e8de" containerID="eedfab04d46db4f491c443ad88eff1eabd0e55886f3dd02af15119099dfa659b" exitCode=0 Sep 14 09:29:09.043225 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.043083 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b92d4" event={"ID":"d1c18c8f-f775-4ace-84dd-3e46e453e8de","Type":"ContainerDied","Data":"eedfab04d46db4f491c443ad88eff1eabd0e55886f3dd02af15119099dfa659b"} Sep 14 09:29:09.061500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.061471 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:29:09.072256 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.072211 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" podStartSLOduration=9.715718732 podStartE2EDuration="28.072195253s" totalImagesPullingTime="18.356476521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:09.071634034 +0000 UTC m=+27.740209137" watchObservedRunningTime="2026-09-14 09:29:09.072195253 +0000 UTC m=+27.740770354" Sep 14 09:29:09.872836 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.872796 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:09.873174 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:09.872965 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:09.873280 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:09.873254 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:09.873423 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:09.873402 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:10.045838 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:10.045807 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:29:10.062316 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:10.062283 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:29:10.741229 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:10.740936 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lk56x"] Sep 14 09:29:10.741397 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:10.741278 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:10.741489 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:10.741387 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:10.744332 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:10.744304 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5q4qs"] Sep 14 09:29:10.744501 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:10.744447 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:10.744576 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:10.744554 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:29:10.745123 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:10.745095 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vdwm6"] Sep 14 09:29:10.745236 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:10.745170 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:10.745287 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:10.745251 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:11.049858 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:11.049773 2559 generic.go:356] "Generic (PLEG): container finished" podID="d1c18c8f-f775-4ace-84dd-3e46e453e8de" containerID="63b5591c207a575eca24d1c2accef2bb1ff40ffa3e085250e2f25f1d0b6911ec" exitCode=0 Sep 14 09:29:11.050229 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:11.049860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b92d4" event={"ID":"d1c18c8f-f775-4ace-84dd-3e46e453e8de","Type":"ContainerDied","Data":"63b5591c207a575eca24d1c2accef2bb1ff40ffa3e085250e2f25f1d0b6911ec"} Sep 14 09:29:12.873495 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:12.873410 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:12.873938 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:12.873490 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:12.873938 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:12.873471 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:12.873938 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:12.873575 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:12.873938 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:12.873668 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:29:12.873938 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:12.873754 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:13.057671 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:13.057636 2559 generic.go:356] "Generic (PLEG): container finished" podID="d1c18c8f-f775-4ace-84dd-3e46e453e8de" containerID="6164ad058f5c0b9c993c7e934ac9d8d8a0185f2c809730099fe9caa19f326adc" exitCode=0 Sep 14 09:29:13.057671 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:13.057677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b92d4" event={"ID":"d1c18c8f-f775-4ace-84dd-3e46e453e8de","Type":"ContainerDied","Data":"6164ad058f5c0b9c993c7e934ac9d8d8a0185f2c809730099fe9caa19f326adc"} Sep 14 09:29:14.873236 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:14.873147 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:14.873236 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:14.873176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:14.873236 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:14.873189 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:14.873760 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:14.873284 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vdwm6" podUID="f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0" Sep 14 09:29:14.873760 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:14.873361 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5q4qs" podUID="18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e" Sep 14 09:29:14.873760 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:14.873485 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lk56x" podUID="d72021a1-6fdb-459b-8b69-008184061dea" Sep 14 09:29:15.512785 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:15.512752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:15.513038 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:15.512907 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 14 09:29:15.513038 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:15.512974 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret podName:18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e nodeName:}" failed. No retries permitted until 2026-09-14 09:29:47.512959083 +0000 UTC m=+66.181534184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret") pod "global-pull-secret-syncer-5q4qs" (UID: "18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e") : object "kube-system"/"original-pull-secret" not registered Sep 14 09:29:15.614062 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:15.614027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:15.614271 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:15.614218 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:29:15.614349 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:15.614307 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs podName:d72021a1-6fdb-459b-8b69-008184061dea nodeName:}" failed. No retries permitted until 2026-09-14 09:29:47.614283657 +0000 UTC m=+66.282858739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs") pod "network-metrics-daemon-lk56x" (UID: "d72021a1-6fdb-459b-8b69-008184061dea") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 14 09:29:15.715448 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:15.715389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:15.715632 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:15.715599 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 14 09:29:15.715632 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:15.715631 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 14 09:29:15.715734 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:15.715647 2559 projected.go:196] Error preparing data for projected volume kube-api-access-9ptf5 for pod openshift-network-diagnostics/network-check-target-vdwm6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:29:15.715734 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:15.715711 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5 podName:f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:47.715691108 +0000 UTC m=+66.384266192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ptf5" (UniqueName: "kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5") pod "network-check-target-vdwm6" (UID: "f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 14 09:29:16.147806 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.147767 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-221.ec2.internal" event="NodeReady" Sep 14 09:29:16.148290 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.147936 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 14 09:29:16.229673 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.229639 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j29rb"] Sep 14 09:29:16.235023 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.234986 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r5j7t"] Sep 14 09:29:16.235196 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.235130 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j29rb" Sep 14 09:29:16.239044 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.239006 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 14 09:29:16.239044 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.239031 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 14 09:29:16.239477 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.239458 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 14 09:29:16.239548 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.239522 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7vv89\"" Sep 14 09:29:16.239622 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.239002 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.242367 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.242299 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 14 09:29:16.243067 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.243046 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 14 09:29:16.243286 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.243269 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lxf72\"" Sep 14 09:29:16.243424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.243405 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j29rb"] Sep 14 09:29:16.258905 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.258872 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:16.259293 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.259272 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r5j7t"] Sep 14 09:29:16.320712 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.320615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/faa52794-2466-4870-98ec-239ab3ac70b2-config-volume\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.320873 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.320741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa52794-2466-4870-98ec-239ab3ac70b2-tmp-dir\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.320873 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.320803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.320873 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.320838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxrnk\" (UniqueName: \"kubernetes.io/projected/faa52794-2466-4870-98ec-239ab3ac70b2-kube-api-access-dxrnk\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.321028 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.320876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99-cert\") pod \"ingress-canary-j29rb\" (UID: \"fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99\") " pod="openshift-ingress-canary/ingress-canary-j29rb" Sep 14 09:29:16.321028 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.320900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkhss\" (UniqueName: \"kubernetes.io/projected/fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99-kube-api-access-dkhss\") pod \"ingress-canary-j29rb\" (UID: \"fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99\") " pod="openshift-ingress-canary/ingress-canary-j29rb" Sep 14 09:29:16.349593 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.349552 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:16.421788 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.421756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa52794-2466-4870-98ec-239ab3ac70b2-tmp-dir\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.421788 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.421792 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.422057 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.421816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxrnk\" (UniqueName: \"kubernetes.io/projected/faa52794-2466-4870-98ec-239ab3ac70b2-kube-api-access-dxrnk\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.422057 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.421842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99-cert\") pod \"ingress-canary-j29rb\" (UID: \"fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99\") " pod="openshift-ingress-canary/ingress-canary-j29rb" Sep 14 09:29:16.422057 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.421858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkhss\" (UniqueName: \"kubernetes.io/projected/fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99-kube-api-access-dkhss\") pod \"ingress-canary-j29rb\" (UID: \"fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99\") " pod="openshift-ingress-canary/ingress-canary-j29rb" Sep 14 09:29:16.422057 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.421903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/faa52794-2466-4870-98ec-239ab3ac70b2-config-volume\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.422057 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:16.421931 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 14 09:29:16.422057 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:16.422007 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls podName:faa52794-2466-4870-98ec-239ab3ac70b2 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:16.921987658 +0000 UTC m=+35.590562737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls") pod "dns-default-r5j7t" (UID: "faa52794-2466-4870-98ec-239ab3ac70b2") : secret "dns-default-metrics-tls" not found Sep 14 09:29:16.422318 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.422168 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faa52794-2466-4870-98ec-239ab3ac70b2-tmp-dir\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.422712 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.422685 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/faa52794-2466-4870-98ec-239ab3ac70b2-config-volume\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.427135 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.426943 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99-cert\") pod \"ingress-canary-j29rb\" (UID: \"fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99\") " pod="openshift-ingress-canary/ingress-canary-j29rb" Sep 14 09:29:16.434335 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.434303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkhss\" (UniqueName: \"kubernetes.io/projected/fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99-kube-api-access-dkhss\") pod \"ingress-canary-j29rb\" (UID: \"fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99\") " pod="openshift-ingress-canary/ingress-canary-j29rb" Sep 14 09:29:16.434467 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.434309 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxrnk\" (UniqueName: \"kubernetes.io/projected/faa52794-2466-4870-98ec-239ab3ac70b2-kube-api-access-dxrnk\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.550453 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.550388 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j29rb" Sep 14 09:29:16.873545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.873503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:16.873545 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.873524 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:16.873797 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.873503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:16.876655 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.876630 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 14 09:29:16.876804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.876634 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 14 09:29:16.877707 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.877684 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 14 09:29:16.877821 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.877709 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 14 09:29:16.877821 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.877720 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5b5r\"" Sep 14 09:29:16.877821 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.877721 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zdtlm\"" Sep 14 09:29:16.896572 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.896536 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:16.924950 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.924918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:16.925135 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:16.925090 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 14 09:29:16.925204 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:16.925187 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls podName:faa52794-2466-4870-98ec-239ab3ac70b2 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:17.925165482 +0000 UTC m=+36.593740581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls") pod "dns-default-r5j7t" (UID: "faa52794-2466-4870-98ec-239ab3ac70b2") : secret "dns-default-metrics-tls" not found Sep 14 09:29:16.997718 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:16.997688 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:17.284649 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:17.284619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j29rb"] Sep 14 09:29:17.298650 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:17.298621 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5b7fed_9d90_43ff_bc7c_0f61c6b7ba99.slice/crio-3ba5234b57a7fae6906fbfbd1db01f5aa88d065ec8fe7761493baadf1f989a02 WatchSource:0}: Error finding container 3ba5234b57a7fae6906fbfbd1db01f5aa88d065ec8fe7761493baadf1f989a02: Status 404 returned error can't find the container with id 3ba5234b57a7fae6906fbfbd1db01f5aa88d065ec8fe7761493baadf1f989a02 Sep 14 09:29:17.416012 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:17.415925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:17.468712 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:17.468681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:17.933322 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:17.933283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:17.933544 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:17.933476 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 14 09:29:17.933626 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:17.933552 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls podName:faa52794-2466-4870-98ec-239ab3ac70b2 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:19.9335311 +0000 UTC m=+38.602106194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls") pod "dns-default-r5j7t" (UID: "faa52794-2466-4870-98ec-239ab3ac70b2") : secret "dns-default-metrics-tls" not found Sep 14 09:29:18.072957 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:18.072914 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j29rb" event={"ID":"fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99","Type":"ContainerStarted","Data":"3ba5234b57a7fae6906fbfbd1db01f5aa88d065ec8fe7761493baadf1f989a02"} Sep 14 09:29:18.076300 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:18.076259 2559 generic.go:356] "Generic (PLEG): container finished" podID="d1c18c8f-f775-4ace-84dd-3e46e453e8de" containerID="62df8575252ae4ecb68ac8316bc584cb60ebdc3716733f3562230fd1fc796e4c" exitCode=0 Sep 14 09:29:18.076453 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:18.076311 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b92d4" event={"ID":"d1c18c8f-f775-4ace-84dd-3e46e453e8de","Type":"ContainerDied","Data":"62df8575252ae4ecb68ac8316bc584cb60ebdc3716733f3562230fd1fc796e4c"} Sep 14 09:29:19.084183 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:19.084142 2559 generic.go:356] "Generic (PLEG): container finished" podID="d1c18c8f-f775-4ace-84dd-3e46e453e8de" containerID="14fbf0decb91dcac86b2f15a5c9b3e904803cd939aa019535ae96203c9655ee4" exitCode=0 Sep 14 09:29:19.084594 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:19.084218 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b92d4" event={"ID":"d1c18c8f-f775-4ace-84dd-3e46e453e8de","Type":"ContainerDied","Data":"14fbf0decb91dcac86b2f15a5c9b3e904803cd939aa019535ae96203c9655ee4"} Sep 14 09:29:19.950756 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:19.950708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:19.950948 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:19.950821 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 14 09:29:19.950948 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:19.950873 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls podName:faa52794-2466-4870-98ec-239ab3ac70b2 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:23.950859405 +0000 UTC m=+42.619434483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls") pod "dns-default-r5j7t" (UID: "faa52794-2466-4870-98ec-239ab3ac70b2") : secret "dns-default-metrics-tls" not found Sep 14 09:29:20.087722 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:20.087684 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j29rb" event={"ID":"fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99","Type":"ContainerStarted","Data":"90dd1add956e58516aa93d239efe15853400c7e29937c3f8e25ba6f1f35fbc69"} Sep 14 09:29:20.091072 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:20.091034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b92d4" event={"ID":"d1c18c8f-f775-4ace-84dd-3e46e453e8de","Type":"ContainerStarted","Data":"4c50fdf90204a94cf631f5d31c52998ca80c311e9762a893b0b6d8894cc76be2"} Sep 14 09:29:20.103416 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:20.103360 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j29rb" podStartSLOduration=1.687133674 podStartE2EDuration="4.103346874s" totalImagesPullingTime="2.4162132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:20.102226265 +0000 UTC m=+38.770801369" watchObservedRunningTime="2026-09-14 09:29:20.103346874 +0000 UTC m=+38.771921975" Sep 14 09:29:20.121499 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:20.121414 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b92d4" podStartSLOduration=10.051795198 podStartE2EDuration="39.121396846s" totalImagesPullingTime="29.069601648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:20.120161491 +0000 UTC m=+38.788736615" watchObservedRunningTime="2026-09-14 09:29:20.121396846 +0000 UTC m=+38.789971946" Sep 14 09:29:20.240329 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:20.240284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:20.302571 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:20.302479 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:21.294942 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:21.294911 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:21.394899 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:21.394868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:21.495867 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:21.495837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:22.142035 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:22.141991 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:22.196359 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:22.196325 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:22.582149 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:22.582116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:22.638393 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:22.638363 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:22.870125 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:22.870041 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:22.962471 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:22.962416 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:23.061865 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.061834 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:23.296673 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.296646 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:23.352664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.352630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:23.884838 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.884808 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx"] Sep 14 09:29:23.922120 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.922073 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx"] Sep 14 09:29:23.922120 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.922108 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" Sep 14 09:29:23.924823 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.924803 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 14 09:29:23.925755 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.925739 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 14 09:29:23.925820 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.925801 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-58blp\"" Sep 14 09:29:23.929949 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.929907 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:23.984036 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:23.983992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:23.984205 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:23.984110 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 14 09:29:23.984205 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:23.984164 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls podName:faa52794-2466-4870-98ec-239ab3ac70b2 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:31.98415015 +0000 UTC m=+50.652725232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls") pod "dns-default-r5j7t" (UID: "faa52794-2466-4870-98ec-239ab3ac70b2") : secret "dns-default-metrics-tls" not found Sep 14 09:29:24.030761 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.030729 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:24.085001 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.084961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qpnr\" (UniqueName: \"kubernetes.io/projected/15367987-72d0-47de-ad8f-0a462146d61c-kube-api-access-5qpnr\") pod \"migrator-8b4d697c5-s4nlx\" (UID: \"15367987-72d0-47de-ad8f-0a462146d61c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" Sep 14 09:29:24.186351 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.186251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qpnr\" (UniqueName: \"kubernetes.io/projected/15367987-72d0-47de-ad8f-0a462146d61c-kube-api-access-5qpnr\") pod \"migrator-8b4d697c5-s4nlx\" (UID: \"15367987-72d0-47de-ad8f-0a462146d61c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" Sep 14 09:29:24.195559 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.195522 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qpnr\" (UniqueName: \"kubernetes.io/projected/15367987-72d0-47de-ad8f-0a462146d61c-kube-api-access-5qpnr\") pod \"migrator-8b4d697c5-s4nlx\" (UID: \"15367987-72d0-47de-ad8f-0a462146d61c\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" Sep 14 09:29:24.231665 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.231629 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" Sep 14 09:29:24.485923 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.485842 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-c2svg"] Sep 14 09:29:24.511295 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.511267 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-c2svg"] Sep 14 09:29:24.511472 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.511386 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.514861 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.514839 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 14 09:29:24.514988 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.514971 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 14 09:29:24.515935 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.515920 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 14 09:29:24.516073 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.515944 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 14 09:29:24.516073 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.515951 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-df5hf\"" Sep 14 09:29:24.530807 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.530785 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx"] Sep 14 09:29:24.546530 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:24.546488 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15367987_72d0_47de_ad8f_0a462146d61c.slice/crio-a023daefb2e13a429d15146a25c3eb0191e0f0b427bcfa0a7b6941ef795482fc WatchSource:0}: Error finding container a023daefb2e13a429d15146a25c3eb0191e0f0b427bcfa0a7b6941ef795482fc: Status 404 returned error can't find the container with id a023daefb2e13a429d15146a25c3eb0191e0f0b427bcfa0a7b6941ef795482fc Sep 14 09:29:24.550378 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.550355 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:24.634579 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.634546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:24.691296 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.691264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4db250fe-c492-440f-9b9b-ee3d962800af-signing-cabundle\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.691463 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.691302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qz2b\" (UniqueName: \"kubernetes.io/projected/4db250fe-c492-440f-9b9b-ee3d962800af-kube-api-access-9qz2b\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.691463 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.691361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4db250fe-c492-440f-9b9b-ee3d962800af-signing-key\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.791823 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.791795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4db250fe-c492-440f-9b9b-ee3d962800af-signing-cabundle\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.791970 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.791831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qz2b\" (UniqueName: \"kubernetes.io/projected/4db250fe-c492-440f-9b9b-ee3d962800af-kube-api-access-9qz2b\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.791970 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.791860 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4db250fe-c492-440f-9b9b-ee3d962800af-signing-key\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.792593 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.792573 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4db250fe-c492-440f-9b9b-ee3d962800af-signing-cabundle\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.794354 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.794330 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4db250fe-c492-440f-9b9b-ee3d962800af-signing-key\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.801788 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.801767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qz2b\" (UniqueName: \"kubernetes.io/projected/4db250fe-c492-440f-9b9b-ee3d962800af-kube-api-access-9qz2b\") pod \"service-ca-568869fdc5-c2svg\" (UID: \"4db250fe-c492-440f-9b9b-ee3d962800af\") " pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:24.820770 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:24.820741 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-c2svg" Sep 14 09:29:25.104721 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:25.104647 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" event={"ID":"15367987-72d0-47de-ad8f-0a462146d61c","Type":"ContainerStarted","Data":"a023daefb2e13a429d15146a25c3eb0191e0f0b427bcfa0a7b6941ef795482fc"} Sep 14 09:29:25.120845 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:25.120809 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-c2svg"] Sep 14 09:29:25.126694 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:25.126664 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db250fe_c492_440f_9b9b_ee3d962800af.slice/crio-72d69ecd031663e052c9a4305199c0e49ac592a5ddc9b44a5fa26c2bd92249b3 WatchSource:0}: Error finding container 72d69ecd031663e052c9a4305199c0e49ac592a5ddc9b44a5fa26c2bd92249b3: Status 404 returned error can't find the container with id 72d69ecd031663e052c9a4305199c0e49ac592a5ddc9b44a5fa26c2bd92249b3 Sep 14 09:29:25.743833 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:25.743799 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:26.108819 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:26.108781 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-c2svg" event={"ID":"4db250fe-c492-440f-9b9b-ee3d962800af","Type":"ContainerStarted","Data":"72d69ecd031663e052c9a4305199c0e49ac592a5ddc9b44a5fa26c2bd92249b3"} Sep 14 09:29:26.377358 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:26.377277 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:26.478090 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:26.478040 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:27.113138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:27.113101 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" event={"ID":"15367987-72d0-47de-ad8f-0a462146d61c","Type":"ContainerStarted","Data":"375ac198baf30e66a3943cdaad6e610fdd3387d54b84e14dbda8871d802da5c7"} Sep 14 09:29:27.113688 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:27.113168 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" event={"ID":"15367987-72d0-47de-ad8f-0a462146d61c","Type":"ContainerStarted","Data":"5f224dba4f91f8de4883beed065c18f13dd74d794179e5399b843eb6bcbcae7b"} Sep 14 09:29:27.129298 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:27.129247 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-s4nlx" podStartSLOduration=2.27432751 podStartE2EDuration="4.129232023s" totalImagesPullingTime="1.854904513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:27.129161626 +0000 UTC m=+45.797736727" watchObservedRunningTime="2026-09-14 09:29:27.129232023 +0000 UTC m=+45.797807123" Sep 14 09:29:28.117990 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:28.117952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-c2svg" event={"ID":"4db250fe-c492-440f-9b9b-ee3d962800af","Type":"ContainerStarted","Data":"b367af63c139c795686b6b7ded9a3a7cd309e3483ab9d33e880edc98935ffdbb"} Sep 14 09:29:28.134560 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:28.134506 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-c2svg" podStartSLOduration=1.555336113 podStartE2EDuration="4.134485308s" totalImagesPullingTime="2.579149195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:28.133876355 +0000 UTC m=+46.802451458" watchObservedRunningTime="2026-09-14 09:29:28.134485308 +0000 UTC m=+46.803060410" Sep 14 09:29:28.890020 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:28.889990 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:29.092520 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:29.092409 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:29.193058 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:29.192970 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:29.294589 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:29.294549 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:29.391072 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:29.391028 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:29.496186 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:29.496060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:29.984772 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:29.984699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:30.384510 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:30.384470 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:30.980127 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:30.980062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:31.586895 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:31.586863 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:31.791035 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:31.790988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:31.979619 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:31.979491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:32.048659 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:32.048613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:32.048827 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:32.048782 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 14 09:29:32.048866 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:32.048856 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls podName:faa52794-2466-4870-98ec-239ab3ac70b2 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:48.048834799 +0000 UTC m=+66.717409891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls") pod "dns-default-r5j7t" (UID: "faa52794-2466-4870-98ec-239ab3ac70b2") : secret "dns-default-metrics-tls" not found Sep 14 09:29:32.385996 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:32.385938 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:32.605614 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:32.605571 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:32.705674 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:32.705570 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:32.806212 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:32.806181 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:32.906243 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:32.906205 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.104518 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.104490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.202880 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.202837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.303248 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.303212 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.404485 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.404365 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.458886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.458857 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.595646 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.595614 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.697706 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.697623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.797171 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.797131 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:33.897635 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:33.897603 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:34.010978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:34.010891 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:34.501284 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:34.501247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:34.600381 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:34.600347 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:34.709320 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:34.709293 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:34.979002 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:34.978973 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:35.351606 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:35.351562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:35.415292 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:35.415262 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:35.510789 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:35.510755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:35.612349 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:35.612258 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:35.712225 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:35.712187 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:36.190014 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:36.189981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:36.588706 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:36.588664 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:37.039864 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:37.039818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:37.327578 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:37.327484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:37.429392 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:37.429358 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:37.787542 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:37.787511 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:38.181510 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:38.181398 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:38.585136 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:38.585106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:38.782760 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:38.782724 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:39.389362 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:39.389330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:39.585122 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:39.585093 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:39.788051 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:39.788017 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:40.707968 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:40.707937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:40.806051 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:40.806019 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:42.063634 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:42.063607 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sf76n" Sep 14 09:29:47.383978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.383937 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-fgvmq"] Sep 14 09:29:47.406179 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.406138 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj"] Sep 14 09:29:47.406373 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.406287 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.409710 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.409686 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 14 09:29:47.410576 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.410557 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 14 09:29:47.410708 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.410654 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 14 09:29:47.410777 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.410706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7kn7s\"" Sep 14 09:29:47.410777 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.410758 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 14 09:29:47.417134 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.417113 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 14 09:29:47.419888 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.419869 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.423470 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.423446 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 14 09:29:47.424627 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.424604 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-fgvmq"] Sep 14 09:29:47.425109 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.425085 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 14 09:29:47.425640 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.425615 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 14 09:29:47.425791 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.425669 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 14 09:29:47.426624 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.426602 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj"] Sep 14 09:29:47.427575 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.427546 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 14 09:29:47.427713 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.427696 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 14 09:29:47.428143 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.428117 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 14 09:29:47.470402 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470359 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.470599 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-hub\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.470599 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.470599 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470532 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-tmp\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.470599 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.470599 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-serving-cert\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.470758 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5230d06e-0145-4c39-bfc8-753049706671-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.470758 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-snapshots\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.470758 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjk8c\" (UniqueName: \"kubernetes.io/projected/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-kube-api-access-fjk8c\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.470758 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-ca\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.470758 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-service-ca-bundle\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.470758 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.470750 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jn8\" (UniqueName: \"kubernetes.io/projected/5230d06e-0145-4c39-bfc8-753049706671-kube-api-access-s7jn8\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.547908 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.547822 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:47.571749 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.571716 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5230d06e-0145-4c39-bfc8-753049706671-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.571749 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.571748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-snapshots\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.571978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.571779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjk8c\" (UniqueName: \"kubernetes.io/projected/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-kube-api-access-fjk8c\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.571978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.571813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-ca\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.571978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.571834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-service-ca-bundle\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.571978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.571875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jn8\" (UniqueName: \"kubernetes.io/projected/5230d06e-0145-4c39-bfc8-753049706671-kube-api-access-s7jn8\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.571978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.571918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.571978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.571950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:47.572280 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.572001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-hub\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.572280 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.572026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.572280 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.572049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-tmp\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.572280 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.572074 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.572280 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.572096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-serving-cert\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.572750 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.572686 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-service-ca-bundle\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.572750 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.572704 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5230d06e-0145-4c39-bfc8-753049706671-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.572750 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.572741 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-snapshots\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.573131 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.573091 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-tmp\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.573336 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.573311 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.575234 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.575214 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 14 09:29:47.575374 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.575351 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-hub\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.575461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.575423 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.575461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.575447 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-ca\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.575539 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.575517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-serving-cert\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.575847 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.575830 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5230d06e-0145-4c39-bfc8-753049706671-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.585714 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.585692 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e-original-pull-secret\") pod \"global-pull-secret-syncer-5q4qs\" (UID: \"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e\") " pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:47.592737 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.592707 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jn8\" (UniqueName: \"kubernetes.io/projected/5230d06e-0145-4c39-bfc8-753049706671-kube-api-access-s7jn8\") pod \"cluster-proxy-proxy-agent-7cd68fd46-29trj\" (UID: \"5230d06e-0145-4c39-bfc8-753049706671\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.593176 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.593154 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjk8c\" (UniqueName: \"kubernetes.io/projected/7b4e400a-913f-4667-bd9d-9dd46b1a6c40-kube-api-access-fjk8c\") pod \"insights-operator-5844b856db-fgvmq\" (UID: \"7b4e400a-913f-4667-bd9d-9dd46b1a6c40\") " pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.668909 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.668824 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:47.673078 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.673056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:47.676209 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.676193 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 14 09:29:47.685888 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.685863 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d72021a1-6fdb-459b-8b69-008184061dea-metrics-certs\") pod \"network-metrics-daemon-lk56x\" (UID: \"d72021a1-6fdb-459b-8b69-008184061dea\") " pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:47.715312 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.715275 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-fgvmq" Sep 14 09:29:47.737629 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.737594 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" Sep 14 09:29:47.774017 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.773528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:47.776255 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.776226 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 14 09:29:47.786639 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.786600 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 14 09:29:47.786804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.786722 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zdtlm\"" Sep 14 09:29:47.795361 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.795149 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lk56x" Sep 14 09:29:47.798400 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.798361 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ptf5\" (UniqueName: \"kubernetes.io/projected/f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0-kube-api-access-9ptf5\") pod \"network-check-target-vdwm6\" (UID: \"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0\") " pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:47.798587 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.798569 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5q4qs" Sep 14 09:29:47.813857 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.813737 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:47.924166 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:47.924092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:48.018983 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.018949 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-fgvmq"] Sep 14 09:29:48.022375 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:48.022349 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4e400a_913f_4667_bd9d_9dd46b1a6c40.slice/crio-d952ea967b04d86028f2c76d5641806675ccf2c4d20dd49d729e5a957c5877be WatchSource:0}: Error finding container d952ea967b04d86028f2c76d5641806675ccf2c4d20dd49d729e5a957c5877be: Status 404 returned error can't find the container with id d952ea967b04d86028f2c76d5641806675ccf2c4d20dd49d729e5a957c5877be Sep 14 09:29:48.025961 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.025937 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:48.063696 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.063665 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj"] Sep 14 09:29:48.066489 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:48.066464 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5230d06e_0145_4c39_bfc8_753049706671.slice/crio-e126ccddea9c1d3c01f0b28fecbf1fcbe691b814210d229447b07187cf421f48 WatchSource:0}: Error finding container e126ccddea9c1d3c01f0b28fecbf1fcbe691b814210d229447b07187cf421f48: Status 404 returned error can't find the container with id e126ccddea9c1d3c01f0b28fecbf1fcbe691b814210d229447b07187cf421f48 Sep 14 09:29:48.087892 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.087851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:48.090561 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.090537 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/faa52794-2466-4870-98ec-239ab3ac70b2-metrics-tls\") pod \"dns-default-r5j7t\" (UID: \"faa52794-2466-4870-98ec-239ab3ac70b2\") " pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:48.091758 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.091735 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lk56x"] Sep 14 09:29:48.093888 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:48.093860 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72021a1_6fdb_459b_8b69_008184061dea.slice/crio-4676b4c34c9c696ca052f913cf1603a90d367c38aa51e72cef0f7ad5aa1a87fb WatchSource:0}: Error finding container 4676b4c34c9c696ca052f913cf1603a90d367c38aa51e72cef0f7ad5aa1a87fb: Status 404 returned error can't find the container with id 4676b4c34c9c696ca052f913cf1603a90d367c38aa51e72cef0f7ad5aa1a87fb Sep 14 09:29:48.096611 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.096592 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g5b5r\"" Sep 14 09:29:48.103729 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.103710 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:48.110869 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.110832 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:48.124901 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.124868 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5q4qs"] Sep 14 09:29:48.127916 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:48.127894 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c02bfb_afbc_4bfb_994a_bc0bbb71fb7e.slice/crio-ebcb01e84ae5af73fa89b6f366c5d561b326699c8643a6b2675e4961e9217127 WatchSource:0}: Error finding container ebcb01e84ae5af73fa89b6f366c5d561b326699c8643a6b2675e4961e9217127: Status 404 returned error can't find the container with id ebcb01e84ae5af73fa89b6f366c5d561b326699c8643a6b2675e4961e9217127 Sep 14 09:29:48.169084 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.169050 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5q4qs" event={"ID":"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e","Type":"ContainerStarted","Data":"ebcb01e84ae5af73fa89b6f366c5d561b326699c8643a6b2675e4961e9217127"} Sep 14 09:29:48.170402 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.170366 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk56x" event={"ID":"d72021a1-6fdb-459b-8b69-008184061dea","Type":"ContainerStarted","Data":"4676b4c34c9c696ca052f913cf1603a90d367c38aa51e72cef0f7ad5aa1a87fb"} Sep 14 09:29:48.172953 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.172379 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fgvmq" event={"ID":"7b4e400a-913f-4667-bd9d-9dd46b1a6c40","Type":"ContainerStarted","Data":"d952ea967b04d86028f2c76d5641806675ccf2c4d20dd49d729e5a957c5877be"} Sep 14 09:29:48.174500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.173927 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" event={"ID":"5230d06e-0145-4c39-bfc8-753049706671","Type":"ContainerStarted","Data":"e126ccddea9c1d3c01f0b28fecbf1fcbe691b814210d229447b07187cf421f48"} Sep 14 09:29:48.213402 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.213346 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:48.367009 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.366968 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lxf72\"" Sep 14 09:29:48.377305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.377274 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:48.413509 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.413473 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vdwm6"] Sep 14 09:29:48.417013 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:48.416991 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e181b1_c6bd_4aab_8cd0_df0fa0cc6cc0.slice/crio-00e91e424671318f7c34f97bcf6a31c49709511ed141aacf90d158c3435bd851 WatchSource:0}: Error finding container 00e91e424671318f7c34f97bcf6a31c49709511ed141aacf90d158c3435bd851: Status 404 returned error can't find the container with id 00e91e424671318f7c34f97bcf6a31c49709511ed141aacf90d158c3435bd851 Sep 14 09:29:48.693328 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:48.692819 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r5j7t"] Sep 14 09:29:48.693458 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:48.693387 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaa52794_2466_4870_98ec_239ab3ac70b2.slice/crio-5869e91a03bde118eb80c6160855c2b6b261ea8c48ddb35536154cdeb0f7a2f4 WatchSource:0}: Error finding container 5869e91a03bde118eb80c6160855c2b6b261ea8c48ddb35536154cdeb0f7a2f4: Status 404 returned error can't find the container with id 5869e91a03bde118eb80c6160855c2b6b261ea8c48ddb35536154cdeb0f7a2f4 Sep 14 09:29:49.179266 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:49.179178 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5j7t" event={"ID":"faa52794-2466-4870-98ec-239ab3ac70b2","Type":"ContainerStarted","Data":"5869e91a03bde118eb80c6160855c2b6b261ea8c48ddb35536154cdeb0f7a2f4"} Sep 14 09:29:49.180622 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:49.180588 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vdwm6" event={"ID":"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0","Type":"ContainerStarted","Data":"00e91e424671318f7c34f97bcf6a31c49709511ed141aacf90d158c3435bd851"} Sep 14 09:29:50.193563 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:50.193447 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk56x" event={"ID":"d72021a1-6fdb-459b-8b69-008184061dea","Type":"ContainerStarted","Data":"3d5600a1d5c74da3c8dd1eb08b2be358065d99b08f916d5d51a73fdd00e5790e"} Sep 14 09:29:50.193563 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:50.193519 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lk56x" event={"ID":"d72021a1-6fdb-459b-8b69-008184061dea","Type":"ContainerStarted","Data":"8f099889326ea6321d4a7884f600773d2202bcb2442f7fff8e901461ea9c12c5"} Sep 14 09:29:50.214595 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:50.213903 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lk56x" podStartSLOduration=67.64126512 podStartE2EDuration="1m9.213879275s" totalImagesPullingTime="1.572614155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:50.210632432 +0000 UTC m=+68.879207537" watchObservedRunningTime="2026-09-14 09:29:50.213879275 +0000 UTC m=+68.882454378" Sep 14 09:29:50.321036 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:50.320981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:50.464446 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:50.464354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:50.564064 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:50.564031 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:51.573693 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:51.573610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:51.726734 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:51.726692 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:51.856869 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:51.856778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:51.960768 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:51.960731 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:52.269301 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:52.269223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:52.968821 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:52.968769 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:53.069689 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:53.069654 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:54.143152 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.143108 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b7b688648-djz2d"] Sep 14 09:29:54.145981 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.145961 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.148787 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.148763 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 14 09:29:54.148914 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.148792 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 14 09:29:54.149867 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.149847 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 14 09:29:54.149956 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.149862 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 14 09:29:54.149956 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.149903 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 14 09:29:54.149956 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.149861 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2rglf\"" Sep 14 09:29:54.150884 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.150868 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 14 09:29:54.150985 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.150931 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 14 09:29:54.155104 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.155083 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 14 09:29:54.156153 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.156131 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:54.158537 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.158483 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7b688648-djz2d"] Sep 14 09:29:54.229804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.229764 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:54.237640 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.237603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-trusted-ca-bundle\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.237826 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.237703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-oauth-serving-cert\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.237826 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.237746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-console-config\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.237826 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.237774 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-service-ca\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.237980 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.237889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-serving-cert\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.237980 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.237921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-oauth-config\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.237980 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.237955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdns2\" (UniqueName: \"kubernetes.io/projected/aa0cf70a-dc0f-4216-821a-065edb821585-kube-api-access-jdns2\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.338920 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.338887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-trusted-ca-bundle\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.338920 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.338934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-oauth-serving-cert\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.339171 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.338970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-console-config\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.339171 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.338996 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-service-ca\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.339171 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.339050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-serving-cert\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.339171 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.339081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-oauth-config\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.339171 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.339117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdns2\" (UniqueName: \"kubernetes.io/projected/aa0cf70a-dc0f-4216-821a-065edb821585-kube-api-access-jdns2\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.339791 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.339752 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-oauth-serving-cert\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.339920 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.339807 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-service-ca\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.339920 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.339820 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-console-config\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.340367 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.340341 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-trusted-ca-bundle\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.342597 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.342574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-serving-cert\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.342851 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.342831 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-oauth-config\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.348685 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.348662 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdns2\" (UniqueName: \"kubernetes.io/projected/aa0cf70a-dc0f-4216-821a-065edb821585-kube-api-access-jdns2\") pod \"console-6b7b688648-djz2d\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:54.457628 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:54.457534 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:29:55.578980 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:55.578920 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:55.679835 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:55.679797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:55.988448 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:55.988396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:56.088719 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:56.088678 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:56.178589 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:56.178554 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:56.375755 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:56.375723 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:56.474815 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:56.474785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:56.898778 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:56.898746 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b7b688648-djz2d"] Sep 14 09:29:56.902115 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:56.902056 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0cf70a_dc0f_4216_821a_065edb821585.slice/crio-23051c73d4d7a35475c1f2157520597a5e9cade0826d460cfd2b3bfe94b226d5 WatchSource:0}: Error finding container 23051c73d4d7a35475c1f2157520597a5e9cade0826d460cfd2b3bfe94b226d5: Status 404 returned error can't find the container with id 23051c73d4d7a35475c1f2157520597a5e9cade0826d460cfd2b3bfe94b226d5 Sep 14 09:29:57.221335 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.221236 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7b688648-djz2d" event={"ID":"aa0cf70a-dc0f-4216-821a-065edb821585","Type":"ContainerStarted","Data":"23051c73d4d7a35475c1f2157520597a5e9cade0826d460cfd2b3bfe94b226d5"} Sep 14 09:29:57.222711 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.222685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5q4qs" event={"ID":"18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e","Type":"ContainerStarted","Data":"c9f36193fc4f372d80b035d602d620268fd7a45380353c06ce1b40ce02d9a754"} Sep 14 09:29:57.224277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.224252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fgvmq" event={"ID":"7b4e400a-913f-4667-bd9d-9dd46b1a6c40","Type":"ContainerStarted","Data":"0d3c9600e1e65cab70a42ce62bd6cd5c333c1892878709f356d0be5f40eefb72"} Sep 14 09:29:57.226221 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.226186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5j7t" event={"ID":"faa52794-2466-4870-98ec-239ab3ac70b2","Type":"ContainerStarted","Data":"ea73d3a8aca5f380075ab7aed3db8ecd92da045027c56fe4b90d99a35aa88d2b"} Sep 14 09:29:57.226336 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.226237 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5j7t" event={"ID":"faa52794-2466-4870-98ec-239ab3ac70b2","Type":"ContainerStarted","Data":"c364fd34c3f65119ccc80828991b68a9ebfdaded7b76b68def5fd71ff6a2d482"} Sep 14 09:29:57.226336 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.226267 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r5j7t" Sep 14 09:29:57.228338 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.228313 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" event={"ID":"5230d06e-0145-4c39-bfc8-753049706671","Type":"ContainerStarted","Data":"6e2f8f2602b04ee0e7e447ce6ae1a915cfbad35f42c1274aba700a72f84f5b19"} Sep 14 09:29:57.228412 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.228355 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" event={"ID":"5230d06e-0145-4c39-bfc8-753049706671","Type":"ContainerStarted","Data":"c83ed4ff9ea4d5ffb8cb35a19820c5f5f53fcf75cbfa0ceb1f57ae346794097f"} Sep 14 09:29:57.228412 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.228373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" event={"ID":"5230d06e-0145-4c39-bfc8-753049706671","Type":"ContainerStarted","Data":"52eb03b1f6ba704d8a35cbe8738061b8ad9423d55e20155e88993907c637fb08"} Sep 14 09:29:57.229877 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.229857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vdwm6" event={"ID":"f2e181b1-c6bd-4aab-8cd0-df0fa0cc6cc0","Type":"ContainerStarted","Data":"1f1e560f58b1570873f6f3816beba3d090448808c05a957acf33103d1b1f75ef"} Sep 14 09:29:57.229989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.229976 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:29:57.239237 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.239193 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5q4qs" podStartSLOduration=67.759861256 podStartE2EDuration="1m16.239179927s" totalImagesPullingTime="8.479318671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:57.238422077 +0000 UTC m=+75.906997179" watchObservedRunningTime="2026-09-14 09:29:57.239179927 +0000 UTC m=+75.907755022" Sep 14 09:29:57.260909 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.260859 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-fgvmq" podStartSLOduration=1.671771584 podStartE2EDuration="10.260839841s" totalImagesPullingTime="8.589068257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:57.260814013 +0000 UTC m=+75.929389113" watchObservedRunningTime="2026-09-14 09:29:57.260839841 +0000 UTC m=+75.929414935" Sep 14 09:29:57.294451 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.294381 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r5j7t" podStartSLOduration=33.380840305 podStartE2EDuration="41.294363687s" totalImagesPullingTime="7.913523382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:57.293592898 +0000 UTC m=+75.962167999" watchObservedRunningTime="2026-09-14 09:29:57.294363687 +0000 UTC m=+75.962938788" Sep 14 09:29:57.321536 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.321422 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cd68fd46-29trj" podStartSLOduration=1.69606573 podStartE2EDuration="10.321404654s" totalImagesPullingTime="8.625338924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:57.320854519 +0000 UTC m=+75.989429621" watchObservedRunningTime="2026-09-14 09:29:57.321404654 +0000 UTC m=+75.989979768" Sep 14 09:29:57.340544 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.340491 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vdwm6" podStartSLOduration=68.149288391 podStartE2EDuration="1m16.34047307s" totalImagesPullingTime="8.191184679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:29:57.339871772 +0000 UTC m=+76.008446876" watchObservedRunningTime="2026-09-14 09:29:57.34047307 +0000 UTC m=+76.009048184" Sep 14 09:29:57.554703 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.554623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:57.669653 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.669578 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:57.883403 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.883324 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-945xh"] Sep 14 09:29:57.886610 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.886575 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:57.889158 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.889068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:57.901724 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.901699 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 14 09:29:57.902620 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:57.902591 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-mhvsz\" is forbidden: User \"system:node:ip-10-0-136-221.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-136-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mhvsz\"" type="*v1.Secret" Sep 14 09:29:57.907449 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.907400 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 14 09:29:57.924223 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:57.924186 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-945xh\" is forbidden: User \"system:node:ip-10-0-136-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-136-221.ec2.internal' and this object" podUID="5cdd7078-7ad7-4564-991d-4a56301cd656" pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:57.966637 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.966594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cdd7078-7ad7-4564-991d-4a56301cd656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:57.966822 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.966647 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s862z\" (UniqueName: \"kubernetes.io/projected/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-api-access-s862z\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:57.966822 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.966680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cdd7078-7ad7-4564-991d-4a56301cd656-data-volume\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:57.966822 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.966714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cdd7078-7ad7-4564-991d-4a56301cd656-crio-socket\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:57.966822 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:57.966753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.044158 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.044123 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-945xh"] Sep 14 09:29:58.067752 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.067717 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cdd7078-7ad7-4564-991d-4a56301cd656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.067752 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.067756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s862z\" (UniqueName: \"kubernetes.io/projected/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-api-access-s862z\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.068001 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.067783 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cdd7078-7ad7-4564-991d-4a56301cd656-data-volume\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.068001 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.067813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cdd7078-7ad7-4564-991d-4a56301cd656-crio-socket\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.068001 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.067851 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.068001 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:58.067875 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 14 09:29:58.068001 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:58.067937 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 14 09:29:58.068159 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.068022 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cdd7078-7ad7-4564-991d-4a56301cd656-crio-socket\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.068159 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:58.067940 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cdd7078-7ad7-4564-991d-4a56301cd656-insights-runtime-extractor-tls podName:5cdd7078-7ad7-4564-991d-4a56301cd656 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:58.56791911 +0000 UTC m=+77.236494207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5cdd7078-7ad7-4564-991d-4a56301cd656-insights-runtime-extractor-tls") pod "insights-runtime-extractor-945xh" (UID: "5cdd7078-7ad7-4564-991d-4a56301cd656") : secret "insights-runtime-extractor-tls" not found Sep 14 09:29:58.068159 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:29:58.068058 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-rbac-proxy-cm podName:5cdd7078-7ad7-4564-991d-4a56301cd656 nodeName:}" failed. No retries permitted until 2026-09-14 09:29:58.568045981 +0000 UTC m=+77.236621064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-rbac-proxy-cm") pod "insights-runtime-extractor-945xh" (UID: "5cdd7078-7ad7-4564-991d-4a56301cd656") : configmap "kube-rbac-proxy" not found Sep 14 09:29:58.068261 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.068178 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cdd7078-7ad7-4564-991d-4a56301cd656-data-volume\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.098782 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.098748 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s862z\" (UniqueName: \"kubernetes.io/projected/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-api-access-s862z\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.337421 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.337374 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:58.551890 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.551856 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:58.573305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.573270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.573501 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.573333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cdd7078-7ad7-4564-991d-4a56301cd656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.573933 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.573879 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cdd7078-7ad7-4564-991d-4a56301cd656-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:58.576093 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:58.576073 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cdd7078-7ad7-4564-991d-4a56301cd656-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-945xh\" (UID: \"5cdd7078-7ad7-4564-991d-4a56301cd656\") " pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:59.451664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:59.451624 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mhvsz\"" Sep 14 09:29:59.459911 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:59.459865 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-945xh" Sep 14 09:29:59.550108 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:59.550072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:59.703481 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:59.703380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:29:59.905642 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:29:59.905608 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-945xh"] Sep 14 09:29:59.908595 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:29:59.908566 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cdd7078_7ad7_4564_991d_4a56301cd656.slice/crio-4c0f7eba54378689ffa719eada60bec1251a8372f8a9ee3dba23fb448a15b76c WatchSource:0}: Error finding container 4c0f7eba54378689ffa719eada60bec1251a8372f8a9ee3dba23fb448a15b76c: Status 404 returned error can't find the container with id 4c0f7eba54378689ffa719eada60bec1251a8372f8a9ee3dba23fb448a15b76c Sep 14 09:30:00.243206 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:00.243111 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-945xh" event={"ID":"5cdd7078-7ad7-4564-991d-4a56301cd656","Type":"ContainerStarted","Data":"8c4a786dc7eea29738dbe6cbb6f0a3cf8be731856129671aa9274279222c2953"} Sep 14 09:30:00.243206 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:00.243175 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-945xh" event={"ID":"5cdd7078-7ad7-4564-991d-4a56301cd656","Type":"ContainerStarted","Data":"4c0f7eba54378689ffa719eada60bec1251a8372f8a9ee3dba23fb448a15b76c"} Sep 14 09:30:00.244754 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:00.244726 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7b688648-djz2d" event={"ID":"aa0cf70a-dc0f-4216-821a-065edb821585","Type":"ContainerStarted","Data":"43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b"} Sep 14 09:30:00.286639 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:00.286586 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b7b688648-djz2d" podStartSLOduration=3.496704851 podStartE2EDuration="6.286567349s" totalImagesPullingTime="2.789862498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:29:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:30:00.28653279 +0000 UTC m=+78.955107892" watchObservedRunningTime="2026-09-14 09:30:00.286567349 +0000 UTC m=+78.955142450" Sep 14 09:30:00.327270 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:00.327240 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b7b688648-djz2d_aa0cf70a-dc0f-4216-821a-065edb821585/console/0.log" Sep 14 09:30:00.432252 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:00.432217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:00.571916 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:00.571880 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:01.251514 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:01.251472 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-945xh" event={"ID":"5cdd7078-7ad7-4564-991d-4a56301cd656","Type":"ContainerStarted","Data":"2c0c128154ad5bd32bf3e0f81e79c3324a382d026a326e2afeebcc6e597a8d00"} Sep 14 09:30:01.517699 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:01.517616 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r5j7t_faa52794-2466-4870-98ec-239ab3ac70b2/dns/0.log" Sep 14 09:30:01.717858 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:01.717828 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r5j7t_faa52794-2466-4870-98ec-239ab3ac70b2/kube-rbac-proxy/0.log" Sep 14 09:30:02.117240 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:02.117212 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q5zms_b85043e0-817d-4fb1-b67b-e5ce2a50adb1/dns-node-resolver/0.log" Sep 14 09:30:02.256929 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:02.256893 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-945xh" event={"ID":"5cdd7078-7ad7-4564-991d-4a56301cd656","Type":"ContainerStarted","Data":"9567df09a251b35d1d4827a0c7afac72c0a0642fb8243398347c92793c3fc303"} Sep 14 09:30:02.279392 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:02.279292 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-945xh" podStartSLOduration=3.300717334 podStartE2EDuration="5.2792759s" totalImagesPullingTime="1.978558566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:29:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:30:02.278651473 +0000 UTC m=+80.947226575" watchObservedRunningTime="2026-09-14 09:30:02.2792759 +0000 UTC m=+80.947851001" Sep 14 09:30:03.317419 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:03.317394 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlfkj_d6d8c6e2-08af-49bd-8210-88043e13a1ca/node-ca/0.log" Sep 14 09:30:04.117400 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:04.117369 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j29rb_fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99/serve-healthcheck-canary/0.log" Sep 14 09:30:04.458630 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:04.458527 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:30:04.458630 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:04.458600 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:30:04.463330 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:04.463303 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:30:04.515373 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:04.515339 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:04.607534 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:04.607500 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:04.859914 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:04.859885 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:04.934833 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:04.934795 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:05.270999 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:05.270918 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:30:05.434216 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:05.434180 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:05.506691 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:05.506631 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:06.332663 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:06.332636 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:06.512372 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:06.512339 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:06.613760 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:06.613687 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:06.712952 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:06.712902 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:07.236756 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:07.236728 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r5j7t" Sep 14 09:30:08.487698 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:08.487661 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:08.686795 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:08.686763 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:09.255731 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.255655 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:09.358441 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.358405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:09.435924 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.435888 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx"] Sep 14 09:30:09.440916 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.440888 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bf8s7"] Sep 14 09:30:09.442319 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.442298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.445589 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.444726 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dgqhz\"" Sep 14 09:30:09.445589 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.444868 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 14 09:30:09.445589 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.444731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.446190 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.446046 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 14 09:30:09.446524 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.446508 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 14 09:30:09.446826 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.446811 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 14 09:30:09.447131 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.447118 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 14 09:30:09.447515 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.447406 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 14 09:30:09.449716 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.448342 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 14 09:30:09.450062 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.450048 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 14 09:30:09.451063 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.450586 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 14 09:30:09.451063 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.450784 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rcls2\"" Sep 14 09:30:09.459729 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.459661 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx"] Sep 14 09:30:09.461179 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.460652 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:09.544622 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.544583 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:09.559221 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559175 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-root\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559415 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559415 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqk6\" (UniqueName: \"kubernetes.io/projected/e618b5f4-107d-499e-bba9-2eac6485068a-kube-api-access-vvqk6\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.559415 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e618b5f4-107d-499e-bba9-2eac6485068a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.559415 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559340 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-textfile\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559415 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf89z\" (UniqueName: \"kubernetes.io/projected/a14a96a3-8256-43d4-98aa-2f5be545137b-kube-api-access-nf89z\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559415 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-sys\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559774 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14a96a3-8256-43d4-98aa-2f5be545137b-metrics-client-ca\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559774 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559512 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-tls\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559774 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.559774 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559602 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-wtmp\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559774 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.559774 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.559774 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e618b5f4-107d-499e-bba9-2eac6485068a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.559774 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.559735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14a96a3-8256-43d4-98aa-2f5be545137b-metrics-client-ca\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-tls\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-wtmp\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660588 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e618b5f4-107d-499e-bba9-2eac6485068a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-root\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660706 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqk6\" (UniqueName: \"kubernetes.io/projected/e618b5f4-107d-499e-bba9-2eac6485068a-kube-api-access-vvqk6\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e618b5f4-107d-499e-bba9-2eac6485068a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-textfile\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf89z\" (UniqueName: \"kubernetes.io/projected/a14a96a3-8256-43d4-98aa-2f5be545137b-kube-api-access-nf89z\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-sys\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.661875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.660921 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-sys\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.662821 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.661523 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a14a96a3-8256-43d4-98aa-2f5be545137b-metrics-client-ca\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.666424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.664069 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-root\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.666424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.664643 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-accelerators-collector-config\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.666424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.665320 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.666424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.665668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-textfile\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.666424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.665960 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e618b5f4-107d-499e-bba9-2eac6485068a-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.666424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.666103 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e618b5f4-107d-499e-bba9-2eac6485068a-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.666424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.666104 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-wtmp\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.673055 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.673006 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqk6\" (UniqueName: \"kubernetes.io/projected/e618b5f4-107d-499e-bba9-2eac6485068a-kube-api-access-vvqk6\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.675048 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.675024 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf89z\" (UniqueName: \"kubernetes.io/projected/a14a96a3-8256-43d4-98aa-2f5be545137b-kube-api-access-nf89z\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.675950 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.675691 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-tls\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.675950 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.675886 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.676506 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.676449 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a14a96a3-8256-43d4-98aa-2f5be545137b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bf8s7\" (UID: \"a14a96a3-8256-43d4-98aa-2f5be545137b\") " pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.677224 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.677197 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e618b5f4-107d-499e-bba9-2eac6485068a-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-8wnnx\" (UID: \"e618b5f4-107d-499e-bba9-2eac6485068a\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.762750 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.762463 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" Sep 14 09:30:09.770924 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.770519 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:09.770924 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.770731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bf8s7" Sep 14 09:30:09.783337 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:30:09.783302 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14a96a3_8256_43d4_98aa_2f5be545137b.slice/crio-515d101afe0e917c2b83d53cae5166be689fcccc028c329d620d05b1936433d6 WatchSource:0}: Error finding container 515d101afe0e917c2b83d53cae5166be689fcccc028c329d620d05b1936433d6: Status 404 returned error can't find the container with id 515d101afe0e917c2b83d53cae5166be689fcccc028c329d620d05b1936433d6 Sep 14 09:30:09.866779 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.866743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:09.969352 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:09.969315 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:10.047831 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:10.047790 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx"] Sep 14 09:30:10.057210 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:30:10.057178 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode618b5f4_107d_499e_bba9_2eac6485068a.slice/crio-ae256488ccf8289bb23b8fa17b1e226a4aa3b49b61f55c585b266b4e219e27f9 WatchSource:0}: Error finding container ae256488ccf8289bb23b8fa17b1e226a4aa3b49b61f55c585b266b4e219e27f9: Status 404 returned error can't find the container with id ae256488ccf8289bb23b8fa17b1e226a4aa3b49b61f55c585b266b4e219e27f9 Sep 14 09:30:10.286865 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:10.286837 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" event={"ID":"e618b5f4-107d-499e-bba9-2eac6485068a","Type":"ContainerStarted","Data":"ae256488ccf8289bb23b8fa17b1e226a4aa3b49b61f55c585b266b4e219e27f9"} Sep 14 09:30:10.288164 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:10.288133 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf8s7" event={"ID":"a14a96a3-8256-43d4-98aa-2f5be545137b","Type":"ContainerStarted","Data":"515d101afe0e917c2b83d53cae5166be689fcccc028c329d620d05b1936433d6"} Sep 14 09:30:10.395694 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:10.395659 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:10.512159 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:10.512131 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:10.660757 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:10.660662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:10.949074 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:10.948945 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:11.060111 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:11.060072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:11.293548 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:11.293503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf8s7" event={"ID":"a14a96a3-8256-43d4-98aa-2f5be545137b","Type":"ContainerStarted","Data":"b66e163dc95ac54215790465f48b2940a3bfc55eb79489b6a5906369a4bedc2d"} Sep 14 09:30:11.388129 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:11.388088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:11.497807 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:11.497785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:12.200835 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.200805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:12.299325 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.299293 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" event={"ID":"e618b5f4-107d-499e-bba9-2eac6485068a","Type":"ContainerStarted","Data":"e3b848946541d9922649f052b55879828167d2c55514d5b4ba2a1e504da3a2d6"} Sep 14 09:30:12.299558 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.299358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" event={"ID":"e618b5f4-107d-499e-bba9-2eac6485068a","Type":"ContainerStarted","Data":"e6b018fdc13598dce5c3843dbe37ec365cf0c41d4f1d869f6ccd5616833b5462"} Sep 14 09:30:12.299558 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.299379 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" event={"ID":"e618b5f4-107d-499e-bba9-2eac6485068a","Type":"ContainerStarted","Data":"a2bcee4efa932b91de1329fde61819e0d71e8b1d51825620330c0e65adb073bc"} Sep 14 09:30:12.300818 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.300795 2559 generic.go:356] "Generic (PLEG): container finished" podID="a14a96a3-8256-43d4-98aa-2f5be545137b" containerID="b66e163dc95ac54215790465f48b2940a3bfc55eb79489b6a5906369a4bedc2d" exitCode=0 Sep 14 09:30:12.300909 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.300863 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf8s7" event={"ID":"a14a96a3-8256-43d4-98aa-2f5be545137b","Type":"ContainerDied","Data":"b66e163dc95ac54215790465f48b2940a3bfc55eb79489b6a5906369a4bedc2d"} Sep 14 09:30:12.302116 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.302069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:12.323644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.323594 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-8wnnx" podStartSLOduration=1.896915576 podStartE2EDuration="3.323577549s" totalImagesPullingTime="1.426661973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:30:12.322524765 +0000 UTC m=+90.991099870" watchObservedRunningTime="2026-09-14 09:30:12.323577549 +0000 UTC m=+90.992152650" Sep 14 09:30:12.452188 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.452103 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:12.544094 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.544060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:12.633112 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.633054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:12.836713 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:12.836680 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:13.306881 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:13.306842 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf8s7" event={"ID":"a14a96a3-8256-43d4-98aa-2f5be545137b","Type":"ContainerStarted","Data":"9e806ae5c323b203ecab68d49d7dfc73f1ca9a45813a7667659f167f6c2e5644"} Sep 14 09:30:13.307335 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:13.306936 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bf8s7" event={"ID":"a14a96a3-8256-43d4-98aa-2f5be545137b","Type":"ContainerStarted","Data":"d406c160a1c9b7fed79502e81ab4df2c7d84b6206f23fe7b61c90576d8e2ed2a"} Sep 14 09:30:13.340885 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:13.340818 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bf8s7" podStartSLOduration=2.966227757 podStartE2EDuration="4.340801189s" totalImagesPullingTime="1.295486751s" totalInitContainerRuntime="79.086681ms" isStatefulPod=true podCreationTimestamp="2026-09-14 09:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:30:13.33982397 +0000 UTC m=+92.008399070" watchObservedRunningTime="2026-09-14 09:30:13.340801189 +0000 UTC m=+92.009376296" Sep 14 09:30:14.195076 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:14.195038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:14.287348 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:14.287313 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:14.370859 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:14.370818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:14.432669 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:14.432610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:14.778766 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:14.778735 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:15.820365 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.820332 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:30:15.821119 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.821097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:15.824039 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.824015 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.828684 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.828663 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 14 09:30:15.828684 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.828665 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 14 09:30:15.828855 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.828783 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 14 09:30:15.828855 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.828808 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 14 09:30:15.828932 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.828906 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gz96g\"" Sep 14 09:30:15.829066 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.829050 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 14 09:30:15.829107 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.829096 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 14 09:30:15.829971 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.829950 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 14 09:30:15.830078 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.829980 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 14 09:30:15.830078 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.830015 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 14 09:30:15.830078 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.830015 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 14 09:30:15.830078 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.830067 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 14 09:30:15.830359 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.830343 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-426h610u49k8g\"" Sep 14 09:30:15.831337 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.831319 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 14 09:30:15.835054 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.835037 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 14 09:30:15.835208 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.835188 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 14 09:30:15.837067 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.837051 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 14 09:30:15.859667 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.859633 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:30:15.912936 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.912895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.912936 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.912939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913168 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.912966 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913168 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913168 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913278 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913278 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913278 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913233 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913278 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913278 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w578z\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-kube-api-access-w578z\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913489 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913489 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913489 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913489 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913489 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913387 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-config\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913489 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913489 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913718 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913494 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913718 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:15.913718 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:15.913535 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014233 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014233 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014271 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014375 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014422 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w578z\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-kube-api-access-w578z\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014501 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014594 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-config\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014658 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014693 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014736 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.014989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.015375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.014983 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.015375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.015090 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.015375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.015207 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.016165 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.016131 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.016165 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.016143 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.017445 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.017403 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-config-out\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.018000 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.017973 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.018509 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.018483 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.018866 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.018841 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.018949 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.018898 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.019094 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.019068 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.019350 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.019325 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.019424 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.019363 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.019652 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.019627 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-config\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.020397 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.020367 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.020590 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.020574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.020704 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.020683 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.020990 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.020971 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-web-config\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.021570 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.021545 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.027738 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.027715 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w578z\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-kube-api-access-w578z\") pod \"prometheus-k8s-0\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.134164 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.134079 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:16.420396 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:16.420366 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:30:16.420548 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:30:16.420364 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd965f552_f857_4f97_8213_edbcfa74ae0f.slice/crio-a5d8ed5d9b6748c8c9ce5fee79598b04f8cb8c14604afdbb24345fa4db5ecde0 WatchSource:0}: Error finding container a5d8ed5d9b6748c8c9ce5fee79598b04f8cb8c14604afdbb24345fa4db5ecde0: Status 404 returned error can't find the container with id a5d8ed5d9b6748c8c9ce5fee79598b04f8cb8c14604afdbb24345fa4db5ecde0 Sep 14 09:30:17.325822 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:17.325789 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerStarted","Data":"a5d8ed5d9b6748c8c9ce5fee79598b04f8cb8c14604afdbb24345fa4db5ecde0"} Sep 14 09:30:17.463763 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:17.463723 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:17.604883 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:17.604803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:18.330743 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:18.330706 2559 generic.go:356] "Generic (PLEG): container finished" podID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" exitCode=0 Sep 14 09:30:18.331206 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:18.330770 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerDied","Data":"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718"} Sep 14 09:30:20.252098 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:20.252049 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:20.310736 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:20.310682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:21.316088 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:21.316053 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:21.375573 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:21.375522 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:22.350251 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:22.350220 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerStarted","Data":"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03"} Sep 14 09:30:22.350638 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:22.350282 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerStarted","Data":"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd"} Sep 14 09:30:25.364384 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:25.364344 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerStarted","Data":"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2"} Sep 14 09:30:25.364869 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:25.364425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerStarted","Data":"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a"} Sep 14 09:30:25.364869 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:25.364507 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerStarted","Data":"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3"} Sep 14 09:30:25.364869 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:25.364545 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerStarted","Data":"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6"} Sep 14 09:30:25.401240 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:25.401183 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.755768531 podStartE2EDuration="10.401165828s" totalImagesPullingTime="7.626243932s" totalInitContainerRuntime="19.153365ms" isStatefulPod=false podCreationTimestamp="2026-09-14 09:30:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:30:25.394122112 +0000 UTC m=+104.062697224" watchObservedRunningTime="2026-09-14 09:30:25.401165828 +0000 UTC m=+104.069740928" Sep 14 09:30:26.134512 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:26.134472 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:30:26.359216 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:26.359180 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:26.458473 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:26.458374 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:28.236907 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:28.236879 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vdwm6" Sep 14 09:30:30.545834 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:30.545797 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7b688648-djz2d"] Sep 14 09:30:30.677773 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:30.677740 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:30.778697 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:30.778664 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:30.833418 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:30.833344 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:35.231306 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:35.231269 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:35.332445 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:35.332411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:48.947102 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:48.947067 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:49.047588 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:49.047548 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:49.101649 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:49.101610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:30:55.566266 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.566196 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b7b688648-djz2d" podUID="aa0cf70a-dc0f-4216-821a-065edb821585" containerName="console" containerID="cri-o://43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b" gracePeriod=15 Sep 14 09:30:55.835480 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.835394 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:30:55.942981 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.942927 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-console-config\") pod \"aa0cf70a-dc0f-4216-821a-065edb821585\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " Sep 14 09:30:55.942981 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.942985 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-oauth-config\") pod \"aa0cf70a-dc0f-4216-821a-065edb821585\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " Sep 14 09:30:55.943244 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943029 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdns2\" (UniqueName: \"kubernetes.io/projected/aa0cf70a-dc0f-4216-821a-065edb821585-kube-api-access-jdns2\") pod \"aa0cf70a-dc0f-4216-821a-065edb821585\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " Sep 14 09:30:55.943244 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943080 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-oauth-serving-cert\") pod \"aa0cf70a-dc0f-4216-821a-065edb821585\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " Sep 14 09:30:55.943244 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943126 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-service-ca\") pod \"aa0cf70a-dc0f-4216-821a-065edb821585\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " Sep 14 09:30:55.943244 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943155 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-serving-cert\") pod \"aa0cf70a-dc0f-4216-821a-065edb821585\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " Sep 14 09:30:55.943244 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943191 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-trusted-ca-bundle\") pod \"aa0cf70a-dc0f-4216-821a-065edb821585\" (UID: \"aa0cf70a-dc0f-4216-821a-065edb821585\") " Sep 14 09:30:55.943504 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943375 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-console-config" (OuterVolumeSpecName: "console-config") pod "aa0cf70a-dc0f-4216-821a-065edb821585" (UID: "aa0cf70a-dc0f-4216-821a-065edb821585"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:30:55.943618 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943595 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-console-config\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:30:55.943683 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943605 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa0cf70a-dc0f-4216-821a-065edb821585" (UID: "aa0cf70a-dc0f-4216-821a-065edb821585"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:30:55.943739 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943701 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aa0cf70a-dc0f-4216-821a-065edb821585" (UID: "aa0cf70a-dc0f-4216-821a-065edb821585"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:30:55.943855 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.943829 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa0cf70a-dc0f-4216-821a-065edb821585" (UID: "aa0cf70a-dc0f-4216-821a-065edb821585"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:30:55.945764 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.945731 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa0cf70a-dc0f-4216-821a-065edb821585" (UID: "aa0cf70a-dc0f-4216-821a-065edb821585"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:30:55.945856 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.945735 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa0cf70a-dc0f-4216-821a-065edb821585-kube-api-access-jdns2" (OuterVolumeSpecName: "kube-api-access-jdns2") pod "aa0cf70a-dc0f-4216-821a-065edb821585" (UID: "aa0cf70a-dc0f-4216-821a-065edb821585"). InnerVolumeSpecName "kube-api-access-jdns2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 14 09:30:55.945918 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:55.945895 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa0cf70a-dc0f-4216-821a-065edb821585" (UID: "aa0cf70a-dc0f-4216-821a-065edb821585"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:30:56.044843 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.044792 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-service-ca\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:30:56.044843 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.044834 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-serving-cert\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:30:56.044843 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.044843 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-trusted-ca-bundle\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:30:56.044843 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.044852 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa0cf70a-dc0f-4216-821a-065edb821585-console-oauth-config\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:30:56.044843 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.044861 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdns2\" (UniqueName: \"kubernetes.io/projected/aa0cf70a-dc0f-4216-821a-065edb821585-kube-api-access-jdns2\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:30:56.045136 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.044869 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa0cf70a-dc0f-4216-821a-065edb821585-oauth-serving-cert\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:30:56.483211 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.483172 2559 generic.go:356] "Generic (PLEG): container finished" podID="aa0cf70a-dc0f-4216-821a-065edb821585" containerID="43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b" exitCode=0 Sep 14 09:30:56.483373 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.483238 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b7b688648-djz2d" Sep 14 09:30:56.483373 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.483251 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7b688648-djz2d" event={"ID":"aa0cf70a-dc0f-4216-821a-065edb821585","Type":"ContainerDied","Data":"43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b"} Sep 14 09:30:56.483373 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.483322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b7b688648-djz2d" event={"ID":"aa0cf70a-dc0f-4216-821a-065edb821585","Type":"ContainerDied","Data":"23051c73d4d7a35475c1f2157520597a5e9cade0826d460cfd2b3bfe94b226d5"} Sep 14 09:30:56.483373 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.483344 2559 scope.go:117] "RemoveContainer" containerID="43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b" Sep 14 09:30:56.492842 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.492822 2559 scope.go:117] "RemoveContainer" containerID="43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b" Sep 14 09:30:56.493134 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:30:56.493099 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b\": container with ID starting with 43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b not found: ID does not exist" containerID="43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b" Sep 14 09:30:56.493197 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.493142 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b"} err="failed to get container status \"43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b\": rpc error: code = NotFound desc = could not find container \"43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b\": container with ID starting with 43db75f3b41a3216b3f2fade1be45d9eef4b50c901ed0ce67618af6f739b683b not found: ID does not exist" Sep 14 09:30:56.504917 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.504890 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b7b688648-djz2d"] Sep 14 09:30:56.511871 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:56.511845 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b7b688648-djz2d"] Sep 14 09:30:57.877743 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:30:57.877702 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa0cf70a-dc0f-4216-821a-065edb821585" path="/var/lib/kubelet/pods/aa0cf70a-dc0f-4216-821a-065edb821585/volumes" Sep 14 09:31:10.828664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:10.828630 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:16.135026 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:16.134986 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:16.154974 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:16.154948 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:16.570560 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:16.570530 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:25.778933 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:25.778898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:25.934794 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:25.934757 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:27.892317 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:27.892284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:27.947502 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:27.947458 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:32.708770 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:32.708685 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:32.761276 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:32.761241 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:34.334694 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.334662 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:31:34.335093 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.334953 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy" containerID="cri-o://aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" gracePeriod=600 Sep 14 09:31:34.335093 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.335003 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy-web" containerID="cri-o://30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" gracePeriod=600 Sep 14 09:31:34.335093 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.334945 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="prometheus" containerID="cri-o://78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" gracePeriod=600 Sep 14 09:31:34.335093 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.335033 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="config-reloader" containerID="cri-o://1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" gracePeriod=600 Sep 14 09:31:34.335304 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.335008 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" gracePeriod=600 Sep 14 09:31:34.335304 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.335025 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="thanos-sidecar" containerID="cri-o://7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" gracePeriod=600 Sep 14 09:31:34.570945 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.570920 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:34.625624 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625544 2559 generic.go:356] "Generic (PLEG): container finished" podID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" exitCode=0 Sep 14 09:31:34.625624 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625565 2559 generic.go:356] "Generic (PLEG): container finished" podID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" exitCode=0 Sep 14 09:31:34.625624 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625571 2559 generic.go:356] "Generic (PLEG): container finished" podID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" exitCode=0 Sep 14 09:31:34.625624 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625576 2559 generic.go:356] "Generic (PLEG): container finished" podID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" exitCode=0 Sep 14 09:31:34.625624 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625582 2559 generic.go:356] "Generic (PLEG): container finished" podID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" exitCode=0 Sep 14 09:31:34.625624 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625587 2559 generic.go:356] "Generic (PLEG): container finished" podID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" exitCode=0 Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625627 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625626 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerDied","Data":"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2"} Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerDied","Data":"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a"} Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625730 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerDied","Data":"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3"} Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625754 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerDied","Data":"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6"} Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625781 2559 scope.go:117] "RemoveContainer" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625784 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerDied","Data":"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03"} Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625880 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerDied","Data":"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd"} Sep 14 09:31:34.626025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.625911 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d965f552-f857-4f97-8213-edbcfa74ae0f","Type":"ContainerDied","Data":"a5d8ed5d9b6748c8c9ce5fee79598b04f8cb8c14604afdbb24345fa4db5ecde0"} Sep 14 09:31:34.637732 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.634859 2559 scope.go:117] "RemoveContainer" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" Sep 14 09:31:34.645128 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645106 2559 scope.go:117] "RemoveContainer" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" Sep 14 09:31:34.645194 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645148 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-trusted-ca-bundle\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645194 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645175 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-0\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645297 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645205 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-config\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645297 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645233 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-2\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645297 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645256 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-metrics-client-ca\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645297 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645287 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645332 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-config-out\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645361 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645398 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-tls\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645422 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-tls-assets\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645471 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-1\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645501 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-serving-certs-ca-bundle\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645524 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-metrics-client-certs\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645581 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-grpc-tls\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645609 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w578z\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-kube-api-access-w578z\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.645644 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645633 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-web-config\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645660 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-thanos-prometheus-http-client-file\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645687 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-kube-rbac-proxy\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645602 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645712 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-kubelet-serving-ca-bundle\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645768 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-db\") pod \"d965f552-f857-4f97-8213-edbcfa74ae0f\" (UID: \"d965f552-f857-4f97-8213-edbcfa74ae0f\") " Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645774 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.645991 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.646007 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.646107 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:31:34.646305 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.646210 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:31:34.646821 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.646671 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:31:34.647249 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.647221 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 14 09:31:34.648093 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.648065 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:31:34.648562 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.648537 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-config" (OuterVolumeSpecName: "config") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.648674 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.648596 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 14 09:31:34.650469 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.650423 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.651190 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.651131 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.651190 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.651143 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-config-out" (OuterVolumeSpecName: "config-out") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 14 09:31:34.651190 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.651173 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.651396 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.651288 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-kube-api-access-w578z" (OuterVolumeSpecName: "kube-api-access-w578z") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "kube-api-access-w578z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 14 09:31:34.651484 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.651413 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.652089 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.652067 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.652707 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.652686 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.653060 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.653041 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 14 09:31:34.653314 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.653297 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.654910 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.654884 2559 scope.go:117] "RemoveContainer" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" Sep 14 09:31:34.661998 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.661978 2559 scope.go:117] "RemoveContainer" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" Sep 14 09:31:34.664477 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.664450 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-web-config" (OuterVolumeSpecName: "web-config") pod "d965f552-f857-4f97-8213-edbcfa74ae0f" (UID: "d965f552-f857-4f97-8213-edbcfa74ae0f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 14 09:31:34.669401 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.669382 2559 scope.go:117] "RemoveContainer" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" Sep 14 09:31:34.676533 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.676516 2559 scope.go:117] "RemoveContainer" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" Sep 14 09:31:34.682767 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.682750 2559 scope.go:117] "RemoveContainer" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" Sep 14 09:31:34.683031 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:31:34.683013 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": container with ID starting with ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2 not found: ID does not exist" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" Sep 14 09:31:34.683070 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.683039 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2"} err="failed to get container status \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": rpc error: code = NotFound desc = could not find container \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": container with ID starting with ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2 not found: ID does not exist" Sep 14 09:31:34.683070 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.683059 2559 scope.go:117] "RemoveContainer" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" Sep 14 09:31:34.683296 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:31:34.683280 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": container with ID starting with aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a not found: ID does not exist" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" Sep 14 09:31:34.683350 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.683302 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a"} err="failed to get container status \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": rpc error: code = NotFound desc = could not find container \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": container with ID starting with aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a not found: ID does not exist" Sep 14 09:31:34.683350 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.683318 2559 scope.go:117] "RemoveContainer" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" Sep 14 09:31:34.683557 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:31:34.683542 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": container with ID starting with 30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3 not found: ID does not exist" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" Sep 14 09:31:34.683602 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.683563 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3"} err="failed to get container status \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": rpc error: code = NotFound desc = could not find container \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": container with ID starting with 30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3 not found: ID does not exist" Sep 14 09:31:34.683602 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.683578 2559 scope.go:117] "RemoveContainer" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" Sep 14 09:31:34.683812 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:31:34.683797 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": container with ID starting with 7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6 not found: ID does not exist" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" Sep 14 09:31:34.683854 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.683817 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6"} err="failed to get container status \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": rpc error: code = NotFound desc = could not find container \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": container with ID starting with 7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6 not found: ID does not exist" Sep 14 09:31:34.683854 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.683831 2559 scope.go:117] "RemoveContainer" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" Sep 14 09:31:34.684032 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:31:34.684017 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": container with ID starting with 1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03 not found: ID does not exist" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" Sep 14 09:31:34.684074 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.684037 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03"} err="failed to get container status \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": rpc error: code = NotFound desc = could not find container \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": container with ID starting with 1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03 not found: ID does not exist" Sep 14 09:31:34.684074 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.684050 2559 scope.go:117] "RemoveContainer" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" Sep 14 09:31:34.684228 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:31:34.684214 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": container with ID starting with 78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd not found: ID does not exist" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" Sep 14 09:31:34.684263 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.684231 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd"} err="failed to get container status \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": rpc error: code = NotFound desc = could not find container \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": container with ID starting with 78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd not found: ID does not exist" Sep 14 09:31:34.684263 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.684242 2559 scope.go:117] "RemoveContainer" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" Sep 14 09:31:34.684564 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:31:34.684544 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": container with ID starting with 91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718 not found: ID does not exist" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" Sep 14 09:31:34.684615 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.684570 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718"} err="failed to get container status \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": rpc error: code = NotFound desc = could not find container \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": container with ID starting with 91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718 not found: ID does not exist" Sep 14 09:31:34.684615 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.684589 2559 scope.go:117] "RemoveContainer" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" Sep 14 09:31:34.684864 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.684848 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2"} err="failed to get container status \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": rpc error: code = NotFound desc = could not find container \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": container with ID starting with ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2 not found: ID does not exist" Sep 14 09:31:34.684909 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.684864 2559 scope.go:117] "RemoveContainer" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" Sep 14 09:31:34.685097 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.685079 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a"} err="failed to get container status \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": rpc error: code = NotFound desc = could not find container \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": container with ID starting with aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a not found: ID does not exist" Sep 14 09:31:34.685142 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.685097 2559 scope.go:117] "RemoveContainer" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" Sep 14 09:31:34.685311 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.685290 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3"} err="failed to get container status \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": rpc error: code = NotFound desc = could not find container \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": container with ID starting with 30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3 not found: ID does not exist" Sep 14 09:31:34.685311 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.685309 2559 scope.go:117] "RemoveContainer" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" Sep 14 09:31:34.685580 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.685562 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6"} err="failed to get container status \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": rpc error: code = NotFound desc = could not find container \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": container with ID starting with 7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6 not found: ID does not exist" Sep 14 09:31:34.685643 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.685582 2559 scope.go:117] "RemoveContainer" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" Sep 14 09:31:34.685813 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.685797 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03"} err="failed to get container status \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": rpc error: code = NotFound desc = could not find container \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": container with ID starting with 1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03 not found: ID does not exist" Sep 14 09:31:34.685851 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.685813 2559 scope.go:117] "RemoveContainer" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" Sep 14 09:31:34.686040 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686022 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd"} err="failed to get container status \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": rpc error: code = NotFound desc = could not find container \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": container with ID starting with 78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd not found: ID does not exist" Sep 14 09:31:34.686040 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686039 2559 scope.go:117] "RemoveContainer" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" Sep 14 09:31:34.686237 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686222 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718"} err="failed to get container status \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": rpc error: code = NotFound desc = could not find container \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": container with ID starting with 91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718 not found: ID does not exist" Sep 14 09:31:34.686280 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686236 2559 scope.go:117] "RemoveContainer" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" Sep 14 09:31:34.686456 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686425 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2"} err="failed to get container status \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": rpc error: code = NotFound desc = could not find container \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": container with ID starting with ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2 not found: ID does not exist" Sep 14 09:31:34.686502 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686458 2559 scope.go:117] "RemoveContainer" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" Sep 14 09:31:34.686654 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686635 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a"} err="failed to get container status \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": rpc error: code = NotFound desc = could not find container \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": container with ID starting with aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a not found: ID does not exist" Sep 14 09:31:34.686722 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686656 2559 scope.go:117] "RemoveContainer" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" Sep 14 09:31:34.686898 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686879 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3"} err="failed to get container status \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": rpc error: code = NotFound desc = could not find container \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": container with ID starting with 30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3 not found: ID does not exist" Sep 14 09:31:34.686942 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.686899 2559 scope.go:117] "RemoveContainer" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" Sep 14 09:31:34.687143 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.687125 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6"} err="failed to get container status \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": rpc error: code = NotFound desc = could not find container \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": container with ID starting with 7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6 not found: ID does not exist" Sep 14 09:31:34.687211 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.687144 2559 scope.go:117] "RemoveContainer" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" Sep 14 09:31:34.687325 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.687307 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03"} err="failed to get container status \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": rpc error: code = NotFound desc = could not find container \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": container with ID starting with 1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03 not found: ID does not exist" Sep 14 09:31:34.687394 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.687327 2559 scope.go:117] "RemoveContainer" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" Sep 14 09:31:34.687580 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.687562 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd"} err="failed to get container status \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": rpc error: code = NotFound desc = could not find container \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": container with ID starting with 78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd not found: ID does not exist" Sep 14 09:31:34.687623 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.687582 2559 scope.go:117] "RemoveContainer" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" Sep 14 09:31:34.687803 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.687786 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718"} err="failed to get container status \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": rpc error: code = NotFound desc = could not find container \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": container with ID starting with 91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718 not found: ID does not exist" Sep 14 09:31:34.687840 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.687804 2559 scope.go:117] "RemoveContainer" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" Sep 14 09:31:34.688026 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688011 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2"} err="failed to get container status \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": rpc error: code = NotFound desc = could not find container \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": container with ID starting with ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2 not found: ID does not exist" Sep 14 09:31:34.688071 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688026 2559 scope.go:117] "RemoveContainer" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" Sep 14 09:31:34.688246 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688228 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a"} err="failed to get container status \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": rpc error: code = NotFound desc = could not find container \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": container with ID starting with aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a not found: ID does not exist" Sep 14 09:31:34.688291 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688247 2559 scope.go:117] "RemoveContainer" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" Sep 14 09:31:34.688461 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688441 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3"} err="failed to get container status \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": rpc error: code = NotFound desc = could not find container \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": container with ID starting with 30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3 not found: ID does not exist" Sep 14 09:31:34.688506 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688462 2559 scope.go:117] "RemoveContainer" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" Sep 14 09:31:34.688664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688649 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6"} err="failed to get container status \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": rpc error: code = NotFound desc = could not find container \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": container with ID starting with 7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6 not found: ID does not exist" Sep 14 09:31:34.688710 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688664 2559 scope.go:117] "RemoveContainer" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" Sep 14 09:31:34.688872 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688856 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03"} err="failed to get container status \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": rpc error: code = NotFound desc = could not find container \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": container with ID starting with 1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03 not found: ID does not exist" Sep 14 09:31:34.688924 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.688872 2559 scope.go:117] "RemoveContainer" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" Sep 14 09:31:34.689115 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.689098 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd"} err="failed to get container status \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": rpc error: code = NotFound desc = could not find container \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": container with ID starting with 78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd not found: ID does not exist" Sep 14 09:31:34.689163 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.689115 2559 scope.go:117] "RemoveContainer" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" Sep 14 09:31:34.689342 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.689321 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718"} err="failed to get container status \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": rpc error: code = NotFound desc = could not find container \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": container with ID starting with 91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718 not found: ID does not exist" Sep 14 09:31:34.689407 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.689343 2559 scope.go:117] "RemoveContainer" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" Sep 14 09:31:34.689615 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.689599 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2"} err="failed to get container status \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": rpc error: code = NotFound desc = could not find container \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": container with ID starting with ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2 not found: ID does not exist" Sep 14 09:31:34.689615 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.689615 2559 scope.go:117] "RemoveContainer" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" Sep 14 09:31:34.689834 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.689818 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a"} err="failed to get container status \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": rpc error: code = NotFound desc = could not find container \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": container with ID starting with aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a not found: ID does not exist" Sep 14 09:31:34.689890 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.689834 2559 scope.go:117] "RemoveContainer" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" Sep 14 09:31:34.690050 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690030 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3"} err="failed to get container status \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": rpc error: code = NotFound desc = could not find container \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": container with ID starting with 30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3 not found: ID does not exist" Sep 14 09:31:34.690104 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690053 2559 scope.go:117] "RemoveContainer" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" Sep 14 09:31:34.690272 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690256 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6"} err="failed to get container status \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": rpc error: code = NotFound desc = could not find container \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": container with ID starting with 7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6 not found: ID does not exist" Sep 14 09:31:34.690315 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690272 2559 scope.go:117] "RemoveContainer" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" Sep 14 09:31:34.690513 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690494 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03"} err="failed to get container status \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": rpc error: code = NotFound desc = could not find container \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": container with ID starting with 1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03 not found: ID does not exist" Sep 14 09:31:34.690568 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690515 2559 scope.go:117] "RemoveContainer" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" Sep 14 09:31:34.690763 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690746 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd"} err="failed to get container status \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": rpc error: code = NotFound desc = could not find container \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": container with ID starting with 78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd not found: ID does not exist" Sep 14 09:31:34.690803 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690764 2559 scope.go:117] "RemoveContainer" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" Sep 14 09:31:34.690980 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690964 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718"} err="failed to get container status \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": rpc error: code = NotFound desc = could not find container \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": container with ID starting with 91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718 not found: ID does not exist" Sep 14 09:31:34.691024 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.690980 2559 scope.go:117] "RemoveContainer" containerID="ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2" Sep 14 09:31:34.691203 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691184 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2"} err="failed to get container status \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": rpc error: code = NotFound desc = could not find container \"ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2\": container with ID starting with ec9d8a22ac22e169ca1db8d51c54f0de496ceb1c4f8805353c6f136c7ba8ebb2 not found: ID does not exist" Sep 14 09:31:34.691239 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691204 2559 scope.go:117] "RemoveContainer" containerID="aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a" Sep 14 09:31:34.691400 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691380 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a"} err="failed to get container status \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": rpc error: code = NotFound desc = could not find container \"aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a\": container with ID starting with aba26dd5282698f88b295ac308ee358666a2cbdcf41e36f26f85de3936029e1a not found: ID does not exist" Sep 14 09:31:34.691462 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691400 2559 scope.go:117] "RemoveContainer" containerID="30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3" Sep 14 09:31:34.691618 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691602 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3"} err="failed to get container status \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": rpc error: code = NotFound desc = could not find container \"30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3\": container with ID starting with 30222883bd59f495557fb22cc0d4dab385ad5941902496b86271f7f489d253f3 not found: ID does not exist" Sep 14 09:31:34.691657 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691618 2559 scope.go:117] "RemoveContainer" containerID="7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6" Sep 14 09:31:34.691820 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691801 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6"} err="failed to get container status \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": rpc error: code = NotFound desc = could not find container \"7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6\": container with ID starting with 7868074d48eb7e9281a93420f9e1bc9ea6deabf6214ddd8c3c65e99d5dadded6 not found: ID does not exist" Sep 14 09:31:34.691865 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691821 2559 scope.go:117] "RemoveContainer" containerID="1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03" Sep 14 09:31:34.692005 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.691987 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03"} err="failed to get container status \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": rpc error: code = NotFound desc = could not find container \"1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03\": container with ID starting with 1156b60a21ab885228a1c78d54daf6b2296c625be4c59a72ade632bfd0207d03 not found: ID does not exist" Sep 14 09:31:34.692048 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.692005 2559 scope.go:117] "RemoveContainer" containerID="78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd" Sep 14 09:31:34.692191 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.692176 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd"} err="failed to get container status \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": rpc error: code = NotFound desc = could not find container \"78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd\": container with ID starting with 78931bd5f15bf5a9764aec0e71998dec449186834013b5d3e89a32ea2b93decd not found: ID does not exist" Sep 14 09:31:34.692232 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.692192 2559 scope.go:117] "RemoveContainer" containerID="91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718" Sep 14 09:31:34.692390 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.692374 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718"} err="failed to get container status \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": rpc error: code = NotFound desc = could not find container \"91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718\": container with ID starting with 91fbd7109a06b73739e75928d9703c5b302049c18c07cddc1ba320c60484d718 not found: ID does not exist" Sep 14 09:31:34.747122 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747096 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747122 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747118 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747132 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-tls-assets\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747140 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747148 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747158 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-metrics-client-certs\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747166 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-grpc-tls\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747174 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w578z\" (UniqueName: \"kubernetes.io/projected/d965f552-f857-4f97-8213-edbcfa74ae0f-kube-api-access-w578z\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747181 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-web-config\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747189 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747198 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-kube-rbac-proxy\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747206 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747215 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-db\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747222 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747233 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-config\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747240 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d965f552-f857-4f97-8213-edbcfa74ae0f-configmap-metrics-client-ca\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747249 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d965f552-f857-4f97-8213-edbcfa74ae0f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.747277 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.747257 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d965f552-f857-4f97-8213-edbcfa74ae0f-config-out\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:31:34.949423 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.949396 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:31:34.954285 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.954258 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:31:34.982119 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982089 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:31:34.982331 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982320 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="thanos-sidecar" Sep 14 09:31:34.982375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982334 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="thanos-sidecar" Sep 14 09:31:34.982375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982349 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa0cf70a-dc0f-4216-821a-065edb821585" containerName="console" Sep 14 09:31:34.982375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982355 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa0cf70a-dc0f-4216-821a-065edb821585" containerName="console" Sep 14 09:31:34.982375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982361 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="prometheus" Sep 14 09:31:34.982375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982366 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="prometheus" Sep 14 09:31:34.982375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982372 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="config-reloader" Sep 14 09:31:34.982375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982377 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="config-reloader" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982385 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy-thanos" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982390 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy-thanos" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982399 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982404 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982410 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="init-config-reloader" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982416 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="init-config-reloader" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982421 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy-web" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982426 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy-web" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982481 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="config-reloader" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982490 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa0cf70a-dc0f-4216-821a-065edb821585" containerName="console" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982495 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="prometheus" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982501 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy-web" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982506 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy-thanos" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982510 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="thanos-sidecar" Sep 14 09:31:34.982583 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.982515 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" containerName="kube-rbac-proxy" Sep 14 09:31:34.986133 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.986116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:34.989242 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.989220 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 14 09:31:34.989743 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.989727 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 14 09:31:34.989939 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.989922 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 14 09:31:34.990328 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.990294 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 14 09:31:34.990446 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.990420 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 14 09:31:34.990727 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.990706 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 14 09:31:34.990797 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.990769 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 14 09:31:34.990797 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.990782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 14 09:31:34.991292 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.991277 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 14 09:31:34.991383 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.991301 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 14 09:31:34.992405 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.992382 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 14 09:31:34.992536 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.992419 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 14 09:31:34.992875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.992860 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gz96g\"" Sep 14 09:31:34.993292 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.993204 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 14 09:31:34.994012 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.993995 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 14 09:31:34.994418 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:34.994403 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-426h610u49k8g\"" Sep 14 09:31:35.003090 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.003065 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 14 09:31:35.018640 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.018613 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:31:35.049352 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049537 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049359 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049537 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxvxm\" (UniqueName: \"kubernetes.io/projected/4589ea29-915a-4c4d-912f-9dc3b0d53999-kube-api-access-nxvxm\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049537 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049484 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-web-config\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4589ea29-915a-4c4d-912f-9dc3b0d53999-config-out\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4589ea29-915a-4c4d-912f-9dc3b0d53999-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049844 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.049886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.050150 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.050150 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.050150 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.049960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.050150 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.050002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-config\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-config\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150375 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150426 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxvxm\" (UniqueName: \"kubernetes.io/projected/4589ea29-915a-4c4d-912f-9dc3b0d53999-kube-api-access-nxvxm\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150658 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-web-config\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.150981 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4589ea29-915a-4c4d-912f-9dc3b0d53999-config-out\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151043 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.150990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151043 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151137 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4589ea29-915a-4c4d-912f-9dc3b0d53999-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151240 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151240 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151240 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151240 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151240 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151688 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151265 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151688 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151290 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151794 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151731 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.151794 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.151785 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.152087 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.152060 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.152383 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.152357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.152796 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.152768 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.154038 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.154009 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.154147 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.154051 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.154678 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.154653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.155165 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.155140 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-web-config\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.155325 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.155296 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.155555 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.155536 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-config\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.155738 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.155719 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4589ea29-915a-4c4d-912f-9dc3b0d53999-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.155852 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.155831 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.155971 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.155951 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.156184 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.156171 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4589ea29-915a-4c4d-912f-9dc3b0d53999-config-out\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.156550 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.156524 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.156783 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.156749 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4589ea29-915a-4c4d-912f-9dc3b0d53999-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.156895 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.156872 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4589ea29-915a-4c4d-912f-9dc3b0d53999-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.158586 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.158570 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxvxm\" (UniqueName: \"kubernetes.io/projected/4589ea29-915a-4c4d-912f-9dc3b0d53999-kube-api-access-nxvxm\") pod \"prometheus-k8s-0\" (UID: \"4589ea29-915a-4c4d-912f-9dc3b0d53999\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.296157 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.296123 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:35.585925 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.585892 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 14 09:31:35.587057 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:31:35.587032 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4589ea29_915a_4c4d_912f_9dc3b0d53999.slice/crio-6bf0d66dc269ea3a3454a15b8c60294d4aa4519590b4772911ae5d45a53f1236 WatchSource:0}: Error finding container 6bf0d66dc269ea3a3454a15b8c60294d4aa4519590b4772911ae5d45a53f1236: Status 404 returned error can't find the container with id 6bf0d66dc269ea3a3454a15b8c60294d4aa4519590b4772911ae5d45a53f1236 Sep 14 09:31:35.631186 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.631161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4589ea29-915a-4c4d-912f-9dc3b0d53999","Type":"ContainerStarted","Data":"6bf0d66dc269ea3a3454a15b8c60294d4aa4519590b4772911ae5d45a53f1236"} Sep 14 09:31:35.877986 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:35.877907 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d965f552-f857-4f97-8213-edbcfa74ae0f" path="/var/lib/kubelet/pods/d965f552-f857-4f97-8213-edbcfa74ae0f/volumes" Sep 14 09:31:36.639938 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:36.636204 2559 generic.go:356] "Generic (PLEG): container finished" podID="4589ea29-915a-4c4d-912f-9dc3b0d53999" containerID="4c2dfb3e9f92737afd305780b4ee4f446463648e4437f56149d41ecfb3ffc945" exitCode=0 Sep 14 09:31:36.639938 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:36.636283 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4589ea29-915a-4c4d-912f-9dc3b0d53999","Type":"ContainerDied","Data":"4c2dfb3e9f92737afd305780b4ee4f446463648e4437f56149d41ecfb3ffc945"} Sep 14 09:31:37.643653 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.643611 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4589ea29-915a-4c4d-912f-9dc3b0d53999","Type":"ContainerStarted","Data":"9c0462e09cfbcec2a376d159b44adbfe197e56864099d708810d3ba1d95ecf34"} Sep 14 09:31:37.644062 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.643674 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4589ea29-915a-4c4d-912f-9dc3b0d53999","Type":"ContainerStarted","Data":"e707e463993d85f5e76c4bdf47eb0679e0d653e72ea7feb388f162c0e2eec6ed"} Sep 14 09:31:37.644062 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.643702 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4589ea29-915a-4c4d-912f-9dc3b0d53999","Type":"ContainerStarted","Data":"80ea3cf4bdc7dabe7c48980bbe7287a9e332fbf5e0f07065a78587e8fa3e3fa4"} Sep 14 09:31:37.644062 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.643725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4589ea29-915a-4c4d-912f-9dc3b0d53999","Type":"ContainerStarted","Data":"ab3b7a9ae5660dbfa383f3638b265e4095c2ea23788e1b623408d2634946124e"} Sep 14 09:31:37.644062 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.643749 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4589ea29-915a-4c4d-912f-9dc3b0d53999","Type":"ContainerStarted","Data":"9b73728bb39a7b3ff37b3e336f23d30ea29703a7599baa9a76ca4c244e8ede69"} Sep 14 09:31:37.644062 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.643788 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4589ea29-915a-4c4d-912f-9dc3b0d53999","Type":"ContainerStarted","Data":"9710a38262ee4edb2d5c882958dc54aa7cd3867954552ed94645789b7250cfd1"} Sep 14 09:31:37.681023 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.680967 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.661445214 podStartE2EDuration="3.680945261s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.500047ms" isStatefulPod=false podCreationTimestamp="2026-09-14 09:31:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:31:37.675799609 +0000 UTC m=+176.344374711" watchObservedRunningTime="2026-09-14 09:31:37.680945261 +0000 UTC m=+176.349520367" Sep 14 09:31:37.683368 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.683334 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:37.737500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:37.737425 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:40.129106 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:40.129044 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:40.183657 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:40.183619 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:40.296951 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:40.296913 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:31:41.466532 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:41.466487 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:41.566141 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:41.566106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:43.947510 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:43.947475 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:44.049532 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:44.049497 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:31:44.148127 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:31:44.148092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:13.377885 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:13.377853 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:13.475699 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:13.475663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:17.988175 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:17.988146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:35.097256 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:35.097217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:35.297160 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:35.297128 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:32:35.313551 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:35.313524 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:32:35.868517 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:35.868490 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 14 09:32:35.927657 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:35.927624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:38.732337 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:38.732304 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:38.833464 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:38.833405 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:40.444903 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:40.444867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:40.551918 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:40.551884 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:40.700444 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:40.700342 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:40.799627 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:40.799594 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:41.731313 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:41.731276 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:41.831094 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:41.831059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:43.066977 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:43.066942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:43.261215 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:43.261181 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:45.496970 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:45.496935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:45.556951 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:45.556916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:50.654642 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:50.654607 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:53.771662 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:53.771598 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:53.879523 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:53.879495 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:32:59.861300 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:32:59.861266 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:01.203592 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:01.203560 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:02.121357 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:02.121317 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:09.480962 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:09.480926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:09.541388 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:09.541358 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:17.734077 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:17.734040 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:17.834066 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:17.834035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:18.335449 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.335387 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:18.639132 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.639050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:18.741018 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.740981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:18.813651 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.813608 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb"] Sep 14 09:33:18.816845 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.816823 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:18.820544 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.820523 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 14 09:33:18.820752 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.820736 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 14 09:33:18.820854 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.820832 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4458x\"" Sep 14 09:33:18.821152 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.821137 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 14 09:33:18.825541 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.825514 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 14 09:33:18.836613 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.836591 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb"] Sep 14 09:33:18.944919 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.944837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:18.946945 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.946924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94715fb3-dd73-44f2-b9c8-a9bda32e604e-webhook-cert\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:18.947050 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.946970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94715fb3-dd73-44f2-b9c8-a9bda32e604e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:18.947050 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.947009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94715fb3-dd73-44f2-b9c8-a9bda32e604e-tmp\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:18.947050 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.947031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl6lv\" (UniqueName: \"kubernetes.io/projected/94715fb3-dd73-44f2-b9c8-a9bda32e604e-kube-api-access-pl6lv\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:18.947182 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:18.947056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94715fb3-dd73-44f2-b9c8-a9bda32e604e-manifests\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.045106 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.045019 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:19.048201 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.048171 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94715fb3-dd73-44f2-b9c8-a9bda32e604e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.048321 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.048223 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94715fb3-dd73-44f2-b9c8-a9bda32e604e-tmp\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.048321 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.048254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl6lv\" (UniqueName: \"kubernetes.io/projected/94715fb3-dd73-44f2-b9c8-a9bda32e604e-kube-api-access-pl6lv\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.048321 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.048294 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94715fb3-dd73-44f2-b9c8-a9bda32e604e-manifests\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.048517 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.048346 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94715fb3-dd73-44f2-b9c8-a9bda32e604e-webhook-cert\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.048775 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.048742 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94715fb3-dd73-44f2-b9c8-a9bda32e604e-manifests\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.050730 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.050708 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94715fb3-dd73-44f2-b9c8-a9bda32e604e-tmp\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.050837 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.050817 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94715fb3-dd73-44f2-b9c8-a9bda32e604e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.051282 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.051262 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94715fb3-dd73-44f2-b9c8-a9bda32e604e-webhook-cert\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.056839 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.056814 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl6lv\" (UniqueName: \"kubernetes.io/projected/94715fb3-dd73-44f2-b9c8-a9bda32e604e-kube-api-access-pl6lv\") pod \"opendatahub-operator-controller-manager-74db9478bb-wlmhb\" (UID: \"94715fb3-dd73-44f2-b9c8-a9bda32e604e\") " pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.127633 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.127597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:19.145989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.145964 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:19.247094 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.247017 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:19.346599 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.346571 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:19.408756 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:19.408732 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb"] Sep 14 09:33:19.411781 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:33:19.411753 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94715fb3_dd73_44f2_b9c8_a9bda32e604e.slice/crio-5ff99c0dc08a49ecf816b8f300238139e75ce1747bb55649d7b676371477f133 WatchSource:0}: Error finding container 5ff99c0dc08a49ecf816b8f300238139e75ce1747bb55649d7b676371477f133: Status 404 returned error can't find the container with id 5ff99c0dc08a49ecf816b8f300238139e75ce1747bb55649d7b676371477f133 Sep 14 09:33:20.006422 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:20.006376 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" event={"ID":"94715fb3-dd73-44f2-b9c8-a9bda32e604e","Type":"ContainerStarted","Data":"5ff99c0dc08a49ecf816b8f300238139e75ce1747bb55649d7b676371477f133"} Sep 14 09:33:23.019287 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:23.019252 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" event={"ID":"94715fb3-dd73-44f2-b9c8-a9bda32e604e","Type":"ContainerStarted","Data":"f19831481ccb311ae9238150beeacba2d2c0ffa3b81e1f724d301c7b810009ae"} Sep 14 09:33:24.024474 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:24.024419 2559 generic.go:356] "Generic (PLEG): container finished" podID="94715fb3-dd73-44f2-b9c8-a9bda32e604e" containerID="f19831481ccb311ae9238150beeacba2d2c0ffa3b81e1f724d301c7b810009ae" exitCode=0 Sep 14 09:33:24.024474 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:24.024460 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" event={"ID":"94715fb3-dd73-44f2-b9c8-a9bda32e604e","Type":"ContainerDied","Data":"f19831481ccb311ae9238150beeacba2d2c0ffa3b81e1f724d301c7b810009ae"} Sep 14 09:33:24.695971 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:24.695849 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:25.031014 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:25.030921 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" event={"ID":"94715fb3-dd73-44f2-b9c8-a9bda32e604e","Type":"ContainerStarted","Data":"948fde8958f1064df7c1e9d77f1dd8e45306e79a9d999f64e8b1ea5026ffa443"} Sep 14 09:33:25.031393 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:25.031035 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:25.053143 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:25.053096 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" podStartSLOduration=2.626464602 podStartE2EDuration="7.053081573s" totalImagesPullingTime="3.341941099s" totalInitContainerRuntime="1.084675872s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:33:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:33:25.051287588 +0000 UTC m=+283.719862681" watchObservedRunningTime="2026-09-14 09:33:25.053081573 +0000 UTC m=+283.721656673" Sep 14 09:33:30.604080 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:30.604039 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:30.704397 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:30.704362 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:36.037071 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:36.037036 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74db9478bb-wlmhb" Sep 14 09:33:37.980172 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:37.980135 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:38.134824 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:38.134780 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:38.350761 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:38.350729 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:38.718920 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:38.718816 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:40.065042 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:40.065012 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:40.137652 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:40.137612 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:41.062003 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:41.061954 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:41.774601 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:41.774569 2559 kubelet.go:1648] "Image garbage collection succeeded" Sep 14 09:33:42.121697 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:42.121658 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:42.205164 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:42.205135 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:42.263554 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:42.263520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:45.125535 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:45.125506 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:45.219420 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:45.219390 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:45.961874 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:45.961842 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:46.066503 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:46.066472 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:46.158019 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:46.157984 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:47.130624 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.130596 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx"] Sep 14 09:33:47.132632 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.132616 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.135176 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.135130 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 14 09:33:47.136025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.136003 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 14 09:33:47.136142 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.136084 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 14 09:33:47.136142 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.136127 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 14 09:33:47.136255 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.136235 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 14 09:33:47.136363 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.136349 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2jwd9\"" Sep 14 09:33:47.142139 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.142119 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx"] Sep 14 09:33:47.168025 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.167989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfwxl\" (UniqueName: \"kubernetes.io/projected/eefacc06-084d-4a5b-a035-61b66905d592-kube-api-access-cfwxl\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.168377 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.168048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eefacc06-084d-4a5b-a035-61b66905d592-manager-config\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.168377 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.168107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eefacc06-084d-4a5b-a035-61b66905d592-cert\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.168377 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.168162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eefacc06-084d-4a5b-a035-61b66905d592-metrics-cert\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.268535 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.268502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eefacc06-084d-4a5b-a035-61b66905d592-manager-config\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.268723 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.268553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eefacc06-084d-4a5b-a035-61b66905d592-cert\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.268723 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.268599 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eefacc06-084d-4a5b-a035-61b66905d592-metrics-cert\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.268723 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.268626 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfwxl\" (UniqueName: \"kubernetes.io/projected/eefacc06-084d-4a5b-a035-61b66905d592-kube-api-access-cfwxl\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.269156 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.269129 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eefacc06-084d-4a5b-a035-61b66905d592-manager-config\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.271202 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.271170 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eefacc06-084d-4a5b-a035-61b66905d592-metrics-cert\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.271307 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.271208 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eefacc06-084d-4a5b-a035-61b66905d592-cert\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.287532 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.287511 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfwxl\" (UniqueName: \"kubernetes.io/projected/eefacc06-084d-4a5b-a035-61b66905d592-kube-api-access-cfwxl\") pod \"lws-controller-manager-9fbfd6689-zcthx\" (UID: \"eefacc06-084d-4a5b-a035-61b66905d592\") " pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.442639 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.442554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:47.710508 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.710483 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx"] Sep 14 09:33:47.712761 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:33:47.712732 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefacc06_084d_4a5b_a035_61b66905d592.slice/crio-54ab194a8791eb8c1e80ef8d68dfe1ddc73c3d213718659feeecb649326d7990 WatchSource:0}: Error finding container 54ab194a8791eb8c1e80ef8d68dfe1ddc73c3d213718659feeecb649326d7990: Status 404 returned error can't find the container with id 54ab194a8791eb8c1e80ef8d68dfe1ddc73c3d213718659feeecb649326d7990 Sep 14 09:33:47.714728 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:47.714711 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 14 09:33:48.115471 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:48.115407 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" event={"ID":"eefacc06-084d-4a5b-a035-61b66905d592","Type":"ContainerStarted","Data":"54ab194a8791eb8c1e80ef8d68dfe1ddc73c3d213718659feeecb649326d7990"} Sep 14 09:33:49.251660 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.251625 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-klb85"] Sep 14 09:33:49.257647 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.257620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:49.260076 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.260043 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zcbqt\"" Sep 14 09:33:49.260218 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.260144 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 14 09:33:49.263267 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.263208 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-klb85"] Sep 14 09:33:49.282721 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.282685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn75j\" (UniqueName: \"kubernetes.io/projected/ad875c8b-66d0-4bc9-9d24-ece842841e6a-kube-api-access-hn75j\") pod \"odh-model-controller-7998c67dc4-klb85\" (UID: \"ad875c8b-66d0-4bc9-9d24-ece842841e6a\") " pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:49.282880 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.282742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad875c8b-66d0-4bc9-9d24-ece842841e6a-cert\") pod \"odh-model-controller-7998c67dc4-klb85\" (UID: \"ad875c8b-66d0-4bc9-9d24-ece842841e6a\") " pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:49.339404 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.339227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:49.383963 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.383926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad875c8b-66d0-4bc9-9d24-ece842841e6a-cert\") pod \"odh-model-controller-7998c67dc4-klb85\" (UID: \"ad875c8b-66d0-4bc9-9d24-ece842841e6a\") " pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:49.384138 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.384035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn75j\" (UniqueName: \"kubernetes.io/projected/ad875c8b-66d0-4bc9-9d24-ece842841e6a-kube-api-access-hn75j\") pod \"odh-model-controller-7998c67dc4-klb85\" (UID: \"ad875c8b-66d0-4bc9-9d24-ece842841e6a\") " pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:49.384205 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:33:49.384162 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 14 09:33:49.384312 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:33:49.384246 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad875c8b-66d0-4bc9-9d24-ece842841e6a-cert podName:ad875c8b-66d0-4bc9-9d24-ece842841e6a nodeName:}" failed. No retries permitted until 2026-09-14 09:33:49.88422717 +0000 UTC m=+308.552802252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad875c8b-66d0-4bc9-9d24-ece842841e6a-cert") pod "odh-model-controller-7998c67dc4-klb85" (UID: "ad875c8b-66d0-4bc9-9d24-ece842841e6a") : secret "odh-model-controller-webhook-cert" not found Sep 14 09:33:49.396103 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.396028 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn75j\" (UniqueName: \"kubernetes.io/projected/ad875c8b-66d0-4bc9-9d24-ece842841e6a-kube-api-access-hn75j\") pod \"odh-model-controller-7998c67dc4-klb85\" (UID: \"ad875c8b-66d0-4bc9-9d24-ece842841e6a\") " pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:49.443419 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.443324 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:49.540191 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.540155 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:49.788029 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.787993 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hhg5l"] Sep 14 09:33:49.790477 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.790391 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:49.792942 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.792916 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 14 09:33:49.802605 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.802555 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hhg5l"] Sep 14 09:33:49.805746 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.805722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:49.887659 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.887630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad875c8b-66d0-4bc9-9d24-ece842841e6a-cert\") pod \"odh-model-controller-7998c67dc4-klb85\" (UID: \"ad875c8b-66d0-4bc9-9d24-ece842841e6a\") " pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:49.887824 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.887673 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72r68\" (UniqueName: \"kubernetes.io/projected/152fb40b-4b77-4290-80c8-93cb6964dae7-kube-api-access-72r68\") pod \"model-serving-api-54d89bd5fc-hhg5l\" (UID: \"152fb40b-4b77-4290-80c8-93cb6964dae7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:49.887824 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.887725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/152fb40b-4b77-4290-80c8-93cb6964dae7-tls-certs\") pod \"model-serving-api-54d89bd5fc-hhg5l\" (UID: \"152fb40b-4b77-4290-80c8-93cb6964dae7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:49.890151 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.890114 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad875c8b-66d0-4bc9-9d24-ece842841e6a-cert\") pod \"odh-model-controller-7998c67dc4-klb85\" (UID: \"ad875c8b-66d0-4bc9-9d24-ece842841e6a\") " pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:49.988924 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.988895 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72r68\" (UniqueName: \"kubernetes.io/projected/152fb40b-4b77-4290-80c8-93cb6964dae7-kube-api-access-72r68\") pod \"model-serving-api-54d89bd5fc-hhg5l\" (UID: \"152fb40b-4b77-4290-80c8-93cb6964dae7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:49.989011 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.988977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/152fb40b-4b77-4290-80c8-93cb6964dae7-tls-certs\") pod \"model-serving-api-54d89bd5fc-hhg5l\" (UID: \"152fb40b-4b77-4290-80c8-93cb6964dae7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:49.989122 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:33:49.989103 2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 14 09:33:49.989182 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:33:49.989171 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152fb40b-4b77-4290-80c8-93cb6964dae7-tls-certs podName:152fb40b-4b77-4290-80c8-93cb6964dae7 nodeName:}" failed. No retries permitted until 2026-09-14 09:33:50.489150189 +0000 UTC m=+309.157725271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/152fb40b-4b77-4290-80c8-93cb6964dae7-tls-certs") pod "model-serving-api-54d89bd5fc-hhg5l" (UID: "152fb40b-4b77-4290-80c8-93cb6964dae7") : secret "model-serving-api-tls" not found Sep 14 09:33:49.999912 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:49.999890 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72r68\" (UniqueName: \"kubernetes.io/projected/152fb40b-4b77-4290-80c8-93cb6964dae7-kube-api-access-72r68\") pod \"model-serving-api-54d89bd5fc-hhg5l\" (UID: \"152fb40b-4b77-4290-80c8-93cb6964dae7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:50.126543 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.126417 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" event={"ID":"eefacc06-084d-4a5b-a035-61b66905d592","Type":"ContainerStarted","Data":"f0f9144935405eaf6932a91fba0ff66834c7f2486bbb27a2cb488808a0e5fc7d"} Sep 14 09:33:50.126543 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.126518 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:33:50.142364 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.142310 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" podStartSLOduration=0.942337464 podStartE2EDuration="3.142291492s" totalImagesPullingTime="2.199954028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:33:50.141256509 +0000 UTC m=+308.809831610" watchObservedRunningTime="2026-09-14 09:33:50.142291492 +0000 UTC m=+308.810866593" Sep 14 09:33:50.172488 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.172451 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:50.283592 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.283561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:33:50.443736 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.443653 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-klb85"] Sep 14 09:33:50.446401 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:33:50.446373 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad875c8b_66d0_4bc9_9d24_ece842841e6a.slice/crio-7dbfc3ab7140472f7e8f775ff86c32b44fafc1de362f30caac86f91fe9744ca6 WatchSource:0}: Error finding container 7dbfc3ab7140472f7e8f775ff86c32b44fafc1de362f30caac86f91fe9744ca6: Status 404 returned error can't find the container with id 7dbfc3ab7140472f7e8f775ff86c32b44fafc1de362f30caac86f91fe9744ca6 Sep 14 09:33:50.494177 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.494143 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/152fb40b-4b77-4290-80c8-93cb6964dae7-tls-certs\") pod \"model-serving-api-54d89bd5fc-hhg5l\" (UID: \"152fb40b-4b77-4290-80c8-93cb6964dae7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:50.496898 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.496869 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/152fb40b-4b77-4290-80c8-93cb6964dae7-tls-certs\") pod \"model-serving-api-54d89bd5fc-hhg5l\" (UID: \"152fb40b-4b77-4290-80c8-93cb6964dae7\") " pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:50.706045 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.705939 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:50.994378 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:50.994353 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hhg5l"] Sep 14 09:33:50.996145 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:33:50.996116 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152fb40b_4b77_4290_80c8_93cb6964dae7.slice/crio-99361df822be5cba162d8a186f0f35fdebbe56a9319d0b0b24216facd34626f3 WatchSource:0}: Error finding container 99361df822be5cba162d8a186f0f35fdebbe56a9319d0b0b24216facd34626f3: Status 404 returned error can't find the container with id 99361df822be5cba162d8a186f0f35fdebbe56a9319d0b0b24216facd34626f3 Sep 14 09:33:51.132950 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:51.132911 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" event={"ID":"152fb40b-4b77-4290-80c8-93cb6964dae7","Type":"ContainerStarted","Data":"99361df822be5cba162d8a186f0f35fdebbe56a9319d0b0b24216facd34626f3"} Sep 14 09:33:51.134500 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:51.134471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-klb85" event={"ID":"ad875c8b-66d0-4bc9-9d24-ece842841e6a","Type":"ContainerStarted","Data":"7dbfc3ab7140472f7e8f775ff86c32b44fafc1de362f30caac86f91fe9744ca6"} Sep 14 09:33:55.155221 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:55.155180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" event={"ID":"152fb40b-4b77-4290-80c8-93cb6964dae7","Type":"ContainerStarted","Data":"b85ab9e5cec9da9d336547b4b791fd9bf06ef2c75907e22bae09cf817c9febd1"} Sep 14 09:33:55.155702 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:55.155293 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:33:55.157003 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:55.156972 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-klb85" event={"ID":"ad875c8b-66d0-4bc9-9d24-ece842841e6a","Type":"ContainerStarted","Data":"2b72eed117083b60008f5213d5bd8a0679322c70aedfd39f023a655c63d9f982"} Sep 14 09:33:55.157140 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:55.157118 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:33:55.171360 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:55.171322 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" podStartSLOduration=2.772952999 podStartE2EDuration="6.171310879s" totalImagesPullingTime="3.39835788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:33:55.170242803 +0000 UTC m=+313.838817906" watchObservedRunningTime="2026-09-14 09:33:55.171310879 +0000 UTC m=+313.839885981" Sep 14 09:33:55.185544 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:55.185500 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-klb85" podStartSLOduration=2.243399136 podStartE2EDuration="6.185487937s" totalImagesPullingTime="3.942088801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:33:55.184391432 +0000 UTC m=+313.852966529" watchObservedRunningTime="2026-09-14 09:33:55.185487937 +0000 UTC m=+313.854063064" Sep 14 09:33:57.231641 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.231600 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq"] Sep 14 09:33:57.233918 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.233896 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.236477 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.236423 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 14 09:33:57.236477 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.236463 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 14 09:33:57.236718 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.236549 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 14 09:33:57.236718 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.236565 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 14 09:33:57.236718 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.236571 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 14 09:33:57.236718 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.236594 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 14 09:33:57.236967 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.236809 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tfmj5\"" Sep 14 09:33:57.249456 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.249411 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq"] Sep 14 09:33:57.258166 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.258147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.258258 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.258178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.258258 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.258198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.258258 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.258246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9xqk\" (UniqueName: \"kubernetes.io/projected/ec5362ce-e50c-44bc-a452-8a6154668b7b-kube-api-access-l9xqk\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.258369 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.258302 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.258369 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.258333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5362ce-e50c-44bc-a452-8a6154668b7b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.258369 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.258362 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.359801 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.359764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.359801 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.359804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5362ce-e50c-44bc-a452-8a6154668b7b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.360017 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.359831 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.360017 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.359862 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.360017 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.359883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.360017 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.359901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.360017 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.359985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9xqk\" (UniqueName: \"kubernetes.io/projected/ec5362ce-e50c-44bc-a452-8a6154668b7b-kube-api-access-l9xqk\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.360655 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.360630 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.362319 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.362286 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.362425 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.362340 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec5362ce-e50c-44bc-a452-8a6154668b7b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.362801 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.362768 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.362858 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.362798 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec5362ce-e50c-44bc-a452-8a6154668b7b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.371935 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.371902 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec5362ce-e50c-44bc-a452-8a6154668b7b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.372050 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.371965 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9xqk\" (UniqueName: \"kubernetes.io/projected/ec5362ce-e50c-44bc-a452-8a6154668b7b-kube-api-access-l9xqk\") pod \"istiod-openshift-gateway-5677ccb49b-7nknq\" (UID: \"ec5362ce-e50c-44bc-a452-8a6154668b7b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.543451 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.543410 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:33:57.819738 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:57.819713 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq"] Sep 14 09:33:57.821327 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:33:57.821296 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5362ce_e50c_44bc_a452_8a6154668b7b.slice/crio-202876d403f066af1dfdf9845d60bc5e54ea5ca139665418173466425e5d6e2c WatchSource:0}: Error finding container 202876d403f066af1dfdf9845d60bc5e54ea5ca139665418173466425e5d6e2c: Status 404 returned error can't find the container with id 202876d403f066af1dfdf9845d60bc5e54ea5ca139665418173466425e5d6e2c Sep 14 09:33:58.170491 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:58.170403 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" event={"ID":"ec5362ce-e50c-44bc-a452-8a6154668b7b","Type":"ContainerStarted","Data":"202876d403f066af1dfdf9845d60bc5e54ea5ca139665418173466425e5d6e2c"} Sep 14 09:33:59.875696 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:33:59.875579 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:00.003467 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:00.003368 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:00.234763 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:00.234682 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:00.298267 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:00.298221 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 14 09:34:00.298345 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:00.298314 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"} Sep 14 09:34:00.336084 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:00.336043 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:01.137412 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.137380 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9fbfd6689-zcthx" Sep 14 09:34:01.187582 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.187550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" event={"ID":"ec5362ce-e50c-44bc-a452-8a6154668b7b","Type":"ContainerStarted","Data":"e6bac6618b25d48dcb59a6facaf9506e2f5dcbb05f0c9708661a2db965eece84"} Sep 14 09:34:01.187813 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.187794 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:34:01.189357 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.189300 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-7nknq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 14 09:34:01.189507 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.189360 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" podUID="ec5362ce-e50c-44bc-a452-8a6154668b7b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 14 09:34:01.203454 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.203401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:01.210858 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.210806 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" podStartSLOduration=1.736850408 podStartE2EDuration="4.21078662s" totalImagesPullingTime="2.473936212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:33:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:34:01.209417931 +0000 UTC m=+319.877993035" watchObservedRunningTime="2026-09-14 09:34:01.21078662 +0000 UTC m=+319.879361722" Sep 14 09:34:01.305418 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.305381 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:01.366626 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:01.366591 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:02.192568 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:02.192539 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7nknq" Sep 14 09:34:06.162513 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:06.162480 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-klb85" Sep 14 09:34:06.164815 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:06.164795 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hhg5l" Sep 14 09:34:06.515636 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:06.515550 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:06.582068 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:06.582037 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:50.050469 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:50.050374 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:34:50.146350 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:34:50.146317 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:01.225221 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:01.225189 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:02.035812 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:02.035783 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:05.164747 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:05.164716 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:05.248153 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:05.248121 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:05.346506 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:05.346477 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:06.349004 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:06.348971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:06.459295 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:06.459248 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:06.550263 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:06.550220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:07.060965 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:07.060930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:07.158636 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:07.158596 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:07.632609 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:07.632569 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:07.883293 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:07.883220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:09.633982 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:09.633955 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:10.026338 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:10.026257 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:10.439978 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:10.439951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:10.694679 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:10.694593 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:14.840980 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:14.840935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:14.944579 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:14.944544 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:15.488032 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:15.487999 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:15.577555 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:15.577521 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:17.269273 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:17.269242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:17.367087 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:17.367052 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:17.470751 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:17.470719 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:17.832047 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:17.832018 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:17.933019 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:17.932983 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:21.747417 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:21.747383 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:21.905886 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:21.905854 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:22.279602 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:22.279564 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:22.350127 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:22.350089 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:27.022613 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:27.022579 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:27.123925 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:27.123897 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:27.258879 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:27.258844 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:32.627504 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.627467 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h"] Sep 14 09:35:32.629750 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.629729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:32.633699 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.633682 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 14 09:35:32.634274 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.634256 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fh42x\"" Sep 14 09:35:32.634318 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.634306 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 14 09:35:32.649301 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.649273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:32.649539 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.649520 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h"] Sep 14 09:35:32.690738 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.690695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e45748bf-3973-4563-be39-a3811d558112-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" (UID: \"e45748bf-3973-4563-be39-a3811d558112\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:32.690738 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.690748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ctw\" (UniqueName: \"kubernetes.io/projected/e45748bf-3973-4563-be39-a3811d558112-kube-api-access-42ctw\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" (UID: \"e45748bf-3973-4563-be39-a3811d558112\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:32.744994 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.744957 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:32.791855 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.791816 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e45748bf-3973-4563-be39-a3811d558112-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" (UID: \"e45748bf-3973-4563-be39-a3811d558112\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:32.792027 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.791865 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ctw\" (UniqueName: \"kubernetes.io/projected/e45748bf-3973-4563-be39-a3811d558112-kube-api-access-42ctw\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" (UID: \"e45748bf-3973-4563-be39-a3811d558112\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:32.792221 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.792202 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e45748bf-3973-4563-be39-a3811d558112-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" (UID: \"e45748bf-3973-4563-be39-a3811d558112\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:32.803040 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.803007 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ctw\" (UniqueName: \"kubernetes.io/projected/e45748bf-3973-4563-be39-a3811d558112-kube-api-access-42ctw\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" (UID: \"e45748bf-3973-4563-be39-a3811d558112\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:32.940226 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:32.940134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:33.008406 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.008370 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h"] Sep 14 09:35:33.023678 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.023648 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h"] Sep 14 09:35:33.332176 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:35:33.332139 2559 log.go:32] "RunPodSandbox from runtime service failed" err=< Sep 14 09:35:33.332176 ip-10-0-136-221 kubenswrapper[2559]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-fcb6h_kuadrant-system_e45748bf-3973-4563-be39-a3811d558112_0(58626e0b076056ea5f4a3358082eff2e762dffe3ba58dc518fa4dce7f0a62e32): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-fcb6h to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"58626e0b076056ea5f4a3358082eff2e762dffe3ba58dc518fa4dce7f0a62e32" Netns:"/var/run/netns/9b350700-d140-4e0f-baef-29e5ea585319" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-fcb6h;K8S_POD_INFRA_CONTAINER_ID=58626e0b076056ea5f4a3358082eff2e762dffe3ba58dc518fa4dce7f0a62e32;K8S_POD_UID=e45748bf-3973-4563-be39-a3811d558112" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h/e45748bf-3973-4563-be39-a3811d558112:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h 58626e0b076056ea5f4a3358082eff2e762dffe3ba58dc518fa4dce7f0a62e32 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:16 [10.134.0.22/23] Sep 14 09:35:33.332176 ip-10-0-136-221 kubenswrapper[2559]: ' Sep 14 09:35:33.332176 ip-10-0-136-221 kubenswrapper[2559]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Sep 14 09:35:33.332176 ip-10-0-136-221 kubenswrapper[2559]: > Sep 14 09:35:33.332365 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:35:33.332210 2559 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Sep 14 09:35:33.332365 ip-10-0-136-221 kubenswrapper[2559]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-fcb6h_kuadrant-system_e45748bf-3973-4563-be39-a3811d558112_0(58626e0b076056ea5f4a3358082eff2e762dffe3ba58dc518fa4dce7f0a62e32): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-fcb6h to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"58626e0b076056ea5f4a3358082eff2e762dffe3ba58dc518fa4dce7f0a62e32" Netns:"/var/run/netns/9b350700-d140-4e0f-baef-29e5ea585319" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-fcb6h;K8S_POD_INFRA_CONTAINER_ID=58626e0b076056ea5f4a3358082eff2e762dffe3ba58dc518fa4dce7f0a62e32;K8S_POD_UID=e45748bf-3973-4563-be39-a3811d558112" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h/e45748bf-3973-4563-be39-a3811d558112:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h 58626e0b076056ea5f4a3358082eff2e762dffe3ba58dc518fa4dce7f0a62e32 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:16 [10.134.0.22/23] Sep 14 09:35:33.332365 ip-10-0-136-221 kubenswrapper[2559]: ' Sep 14 09:35:33.332365 ip-10-0-136-221 kubenswrapper[2559]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Sep 14 09:35:33.332365 ip-10-0-136-221 kubenswrapper[2559]: > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:33.570127 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.570096 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:33.572530 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:35:33.572504 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" is forbidden: User \"system:node:ip-10-0-136-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-221.ec2.internal' and this object" podUID="e45748bf-3973-4563-be39-a3811d558112" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:33.575748 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.575725 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:33.577734 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:35:33.577707 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" is forbidden: User \"system:node:ip-10-0-136-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-221.ec2.internal' and this object" podUID="e45748bf-3973-4563-be39-a3811d558112" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:33.600897 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.600855 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e45748bf-3973-4563-be39-a3811d558112-extensions-socket-volume\") pod \"e45748bf-3973-4563-be39-a3811d558112\" (UID: \"e45748bf-3973-4563-be39-a3811d558112\") " Sep 14 09:35:33.600897 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.600900 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42ctw\" (UniqueName: \"kubernetes.io/projected/e45748bf-3973-4563-be39-a3811d558112-kube-api-access-42ctw\") pod \"e45748bf-3973-4563-be39-a3811d558112\" (UID: \"e45748bf-3973-4563-be39-a3811d558112\") " Sep 14 09:35:33.601114 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.601091 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e45748bf-3973-4563-be39-a3811d558112-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e45748bf-3973-4563-be39-a3811d558112" (UID: "e45748bf-3973-4563-be39-a3811d558112"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 14 09:35:33.603075 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.603049 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e45748bf-3973-4563-be39-a3811d558112-kube-api-access-42ctw" (OuterVolumeSpecName: "kube-api-access-42ctw") pod "e45748bf-3973-4563-be39-a3811d558112" (UID: "e45748bf-3973-4563-be39-a3811d558112"). InnerVolumeSpecName "kube-api-access-42ctw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 14 09:35:33.701866 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.701831 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e45748bf-3973-4563-be39-a3811d558112-extensions-socket-volume\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:35:33.701866 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.701860 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42ctw\" (UniqueName: \"kubernetes.io/projected/e45748bf-3973-4563-be39-a3811d558112-kube-api-access-42ctw\") on node \"ip-10-0-136-221.ec2.internal\" DevicePath \"\"" Sep 14 09:35:33.878213 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:33.878123 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e45748bf-3973-4563-be39-a3811d558112" path="/var/lib/kubelet/pods/e45748bf-3973-4563-be39-a3811d558112/volumes" Sep 14 09:35:34.036674 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:34.036636 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:34.134699 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:34.134613 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:34.573577 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:34.573549 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:34.577705 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:35:34.577668 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-fcb6h\" is forbidden: User \"system:node:ip-10-0-136-221.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-221.ec2.internal' and this object" podUID="e45748bf-3973-4563-be39-a3811d558112" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-fcb6h" Sep 14 09:35:35.558498 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:35.558468 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:35.659536 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:35.659503 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:37.455813 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:37.455782 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:37.555679 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:37.555649 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:37.616787 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:37.616755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:41.626135 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:41.626099 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:41.728105 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:41.728077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:45.341960 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.341931 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d"] Sep 14 09:35:45.344062 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.344044 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:45.346840 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.346816 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fh42x\"" Sep 14 09:35:45.346840 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.346834 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 14 09:35:45.346994 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.346853 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 14 09:35:45.364555 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.364533 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d"] Sep 14 09:35:45.404671 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.404639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0166f61b-38ec-45e6-87d6-f1b373a1a14c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gqm9d\" (UID: \"0166f61b-38ec-45e6-87d6-f1b373a1a14c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:45.404855 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.404689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlzhn\" (UniqueName: \"kubernetes.io/projected/0166f61b-38ec-45e6-87d6-f1b373a1a14c-kube-api-access-tlzhn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gqm9d\" (UID: \"0166f61b-38ec-45e6-87d6-f1b373a1a14c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:45.505977 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.505931 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlzhn\" (UniqueName: \"kubernetes.io/projected/0166f61b-38ec-45e6-87d6-f1b373a1a14c-kube-api-access-tlzhn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gqm9d\" (UID: \"0166f61b-38ec-45e6-87d6-f1b373a1a14c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:45.506175 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.506052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0166f61b-38ec-45e6-87d6-f1b373a1a14c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gqm9d\" (UID: \"0166f61b-38ec-45e6-87d6-f1b373a1a14c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:45.506419 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.506397 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0166f61b-38ec-45e6-87d6-f1b373a1a14c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gqm9d\" (UID: \"0166f61b-38ec-45e6-87d6-f1b373a1a14c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:45.519753 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.519728 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlzhn\" (UniqueName: \"kubernetes.io/projected/0166f61b-38ec-45e6-87d6-f1b373a1a14c-kube-api-access-tlzhn\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gqm9d\" (UID: \"0166f61b-38ec-45e6-87d6-f1b373a1a14c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:45.654104 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.654016 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:45.926390 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:45.926360 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d"] Sep 14 09:35:45.928104 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:35:45.928080 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0166f61b_38ec_45e6_87d6_f1b373a1a14c.slice/crio-72f0f4581b26fb1c0f5a6aae6e72d5242d3e4f0fc51b3a0c2d29cf03973b2780 WatchSource:0}: Error finding container 72f0f4581b26fb1c0f5a6aae6e72d5242d3e4f0fc51b3a0c2d29cf03973b2780: Status 404 returned error can't find the container with id 72f0f4581b26fb1c0f5a6aae6e72d5242d3e4f0fc51b3a0c2d29cf03973b2780 Sep 14 09:35:46.379146 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:46.379105 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:46.484805 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:46.484752 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:46.579245 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:46.579207 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:35:46.626047 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:46.625992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" event={"ID":"0166f61b-38ec-45e6-87d6-f1b373a1a14c","Type":"ContainerStarted","Data":"72f0f4581b26fb1c0f5a6aae6e72d5242d3e4f0fc51b3a0c2d29cf03973b2780"} Sep 14 09:35:50.645906 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:50.645869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" event={"ID":"0166f61b-38ec-45e6-87d6-f1b373a1a14c","Type":"ContainerStarted","Data":"01cf20921ae296beb98e266892ef26f480dfa73365b4db0e46ac0f55e8641f4e"} Sep 14 09:35:50.646291 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:50.645957 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:35:50.667455 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:35:50.667394 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" podStartSLOduration=1.920638548 podStartE2EDuration="5.667377388s" totalImagesPullingTime="3.74673884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:35:50.66606065 +0000 UTC m=+429.334635752" watchObservedRunningTime="2026-09-14 09:35:50.667377388 +0000 UTC m=+429.335952489" Sep 14 09:36:01.550716 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:01.550681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:01.652909 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:01.652878 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gqm9d" Sep 14 09:36:02.055694 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:02.055662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:20.673235 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:20.673197 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:20.777081 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:20.777050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:20.879655 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:20.879622 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:21.588318 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:21.588256 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:21.658124 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:21.658091 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:37.696751 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:37.696708 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:37.795275 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:37.795242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:38.217006 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:38.216979 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:47.823629 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:47.823592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:47.967099 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:47.967066 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:55.036698 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.036652 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:55.137865 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.137827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:55.207050 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.207017 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:55.280320 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.280284 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-846c9b9db5-6v8zs"] Sep 14 09:36:55.283709 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.283689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.287374 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.287304 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nhjpw\"" Sep 14 09:36:55.287374 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.287357 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 14 09:36:55.287585 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.287370 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 14 09:36:55.287585 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.287469 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 14 09:36:55.297114 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.297086 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-846c9b9db5-6v8zs"] Sep 14 09:36:55.320256 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.320225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-metrics-certs\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.320421 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.320327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79bbh\" (UniqueName: \"kubernetes.io/projected/d25060bf-6260-457f-9974-1124cd4a99fb-kube-api-access-79bbh\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.320421 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.320408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-webhook-cert\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.406502 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.406468 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:55.421664 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.421633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79bbh\" (UniqueName: \"kubernetes.io/projected/d25060bf-6260-457f-9974-1124cd4a99fb-kube-api-access-79bbh\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.421804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.421678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-webhook-cert\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.421804 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.421708 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-metrics-certs\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.421804 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:36:55.421797 2559 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found Sep 14 09:36:55.421926 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:36:55.421858 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-metrics-certs podName:d25060bf-6260-457f-9974-1124cd4a99fb nodeName:}" failed. No retries permitted until 2026-09-14 09:36:55.92184173 +0000 UTC m=+494.590416809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-metrics-certs") pod "maas-controller-846c9b9db5-6v8zs" (UID: "d25060bf-6260-457f-9974-1124cd4a99fb") : secret "maas-controller-metrics-tls" not found Sep 14 09:36:55.424241 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.424218 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-webhook-cert\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.433542 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.433514 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79bbh\" (UniqueName: \"kubernetes.io/projected/d25060bf-6260-457f-9974-1124cd4a99fb-kube-api-access-79bbh\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.823749 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.823699 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:36:55.926486 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.926452 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-metrics-certs\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:55.929070 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:55.929041 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d25060bf-6260-457f-9974-1124cd4a99fb-metrics-certs\") pod \"maas-controller-846c9b9db5-6v8zs\" (UID: \"d25060bf-6260-457f-9974-1124cd4a99fb\") " pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:56.194276 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:56.194198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:36:56.476705 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:56.476680 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-846c9b9db5-6v8zs"] Sep 14 09:36:56.478195 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:36:56.478169 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25060bf_6260_457f_9974_1124cd4a99fb.slice/crio-54bd0881f55d711aae55f2ed28b567f4a830b1cf0f2c4ac3366b3d3c3b9b24c5 WatchSource:0}: Error finding container 54bd0881f55d711aae55f2ed28b567f4a830b1cf0f2c4ac3366b3d3c3b9b24c5: Status 404 returned error can't find the container with id 54bd0881f55d711aae55f2ed28b567f4a830b1cf0f2c4ac3366b3d3c3b9b24c5 Sep 14 09:36:56.935625 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:56.935581 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" event={"ID":"d25060bf-6260-457f-9974-1124cd4a99fb","Type":"ContainerStarted","Data":"54bd0881f55d711aae55f2ed28b567f4a830b1cf0f2c4ac3366b3d3c3b9b24c5"} Sep 14 09:36:58.945763 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:58.945725 2559 generic.go:356] "Generic (PLEG): container finished" podID="d25060bf-6260-457f-9974-1124cd4a99fb" containerID="662620f4a1e4e6450ca97234fc4d0b537462c54b8fc71856b9decd9ac8c7356b" exitCode=2 Sep 14 09:36:58.946155 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:58.945777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" event={"ID":"d25060bf-6260-457f-9974-1124cd4a99fb","Type":"ContainerDied","Data":"662620f4a1e4e6450ca97234fc4d0b537462c54b8fc71856b9decd9ac8c7356b"} Sep 14 09:36:58.946155 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:58.946031 2559 scope.go:117] "RemoveContainer" containerID="662620f4a1e4e6450ca97234fc4d0b537462c54b8fc71856b9decd9ac8c7356b" Sep 14 09:36:59.957506 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:59.957468 2559 generic.go:356] "Generic (PLEG): container finished" podID="d25060bf-6260-457f-9974-1124cd4a99fb" containerID="ae844b30443af33e4e267b41bfd4df4ed68a45b996279d66a8dc1613d3a9d1e2" exitCode=2 Sep 14 09:36:59.957968 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:59.957546 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" event={"ID":"d25060bf-6260-457f-9974-1124cd4a99fb","Type":"ContainerDied","Data":"ae844b30443af33e4e267b41bfd4df4ed68a45b996279d66a8dc1613d3a9d1e2"} Sep 14 09:36:59.957968 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:59.957617 2559 scope.go:117] "RemoveContainer" containerID="662620f4a1e4e6450ca97234fc4d0b537462c54b8fc71856b9decd9ac8c7356b" Sep 14 09:36:59.957968 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:36:59.957846 2559 scope.go:117] "RemoveContainer" containerID="ae844b30443af33e4e267b41bfd4df4ed68a45b996279d66a8dc1613d3a9d1e2" Sep 14 09:36:59.958116 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:36:59.958071 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:37:00.963808 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:00.963783 2559 scope.go:117] "RemoveContainer" containerID="ae844b30443af33e4e267b41bfd4df4ed68a45b996279d66a8dc1613d3a9d1e2" Sep 14 09:37:00.964197 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:37:00.963943 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:37:04.465726 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:04.465689 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:37:04.565828 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:04.565798 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:37:06.195285 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:06.195240 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:37:06.195713 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:06.195675 2559 scope.go:117] "RemoveContainer" containerID="ae844b30443af33e4e267b41bfd4df4ed68a45b996279d66a8dc1613d3a9d1e2" Sep 14 09:37:06.195853 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:37:06.195834 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:37:16.195336 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:16.195296 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:37:16.195761 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:16.195743 2559 scope.go:117] "RemoveContainer" containerID="ae844b30443af33e4e267b41bfd4df4ed68a45b996279d66a8dc1613d3a9d1e2" Sep 14 09:37:17.037657 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:17.037624 2559 generic.go:356] "Generic (PLEG): container finished" podID="d25060bf-6260-457f-9974-1124cd4a99fb" containerID="a035d19ce0b1f733b84dee57ea509699e0c76cbecc17101d33a8e5631099d98a" exitCode=2 Sep 14 09:37:17.037826 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:17.037693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" event={"ID":"d25060bf-6260-457f-9974-1124cd4a99fb","Type":"ContainerDied","Data":"a035d19ce0b1f733b84dee57ea509699e0c76cbecc17101d33a8e5631099d98a"} Sep 14 09:37:17.037826 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:17.037753 2559 scope.go:117] "RemoveContainer" containerID="ae844b30443af33e4e267b41bfd4df4ed68a45b996279d66a8dc1613d3a9d1e2" Sep 14 09:37:17.038069 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:17.038053 2559 scope.go:117] "RemoveContainer" containerID="a035d19ce0b1f733b84dee57ea509699e0c76cbecc17101d33a8e5631099d98a" Sep 14 09:37:17.038257 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:37:17.038238 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:37:26.194382 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:26.194354 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:37:26.194867 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:26.194746 2559 scope.go:117] "RemoveContainer" containerID="a035d19ce0b1f733b84dee57ea509699e0c76cbecc17101d33a8e5631099d98a" Sep 14 09:37:26.194935 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:37:26.194915 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:37:36.195372 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:36.195285 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:37:36.195870 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:36.195812 2559 scope.go:117] "RemoveContainer" containerID="a035d19ce0b1f733b84dee57ea509699e0c76cbecc17101d33a8e5631099d98a" Sep 14 09:37:36.196044 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:37:36.196019 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:37:49.873674 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:49.873639 2559 scope.go:117] "RemoveContainer" containerID="a035d19ce0b1f733b84dee57ea509699e0c76cbecc17101d33a8e5631099d98a" Sep 14 09:37:51.186876 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:51.186841 2559 generic.go:356] "Generic (PLEG): container finished" podID="d25060bf-6260-457f-9974-1124cd4a99fb" containerID="38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025" exitCode=2 Sep 14 09:37:51.187268 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:51.186911 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" event={"ID":"d25060bf-6260-457f-9974-1124cd4a99fb","Type":"ContainerDied","Data":"38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025"} Sep 14 09:37:51.187268 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:51.186972 2559 scope.go:117] "RemoveContainer" containerID="a035d19ce0b1f733b84dee57ea509699e0c76cbecc17101d33a8e5631099d98a" Sep 14 09:37:51.187348 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:51.187305 2559 scope.go:117] "RemoveContainer" containerID="38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025" Sep 14 09:37:51.187535 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:37:51.187507 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:37:56.194363 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:56.194329 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:37:56.194864 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:56.194426 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:37:56.194864 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:56.194801 2559 scope.go:117] "RemoveContainer" containerID="38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025" Sep 14 09:37:56.195031 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:37:56.195008 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:37:56.211875 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:37:56.211847 2559 scope.go:117] "RemoveContainer" containerID="38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025" Sep 14 09:37:56.212060 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:37:56.212039 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:38:08.873475 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:08.873415 2559 scope.go:117] "RemoveContainer" containerID="38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025" Sep 14 09:38:08.873922 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:38:08.873611 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:38:11.550623 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:11.550586 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:38:12.881618 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:12.881588 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:38:19.873620 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:19.873586 2559 scope.go:117] "RemoveContainer" containerID="38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025" Sep 14 09:38:19.874100 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:38:19.873815 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:38:29.872192 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:29.872161 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:38:32.872843 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:32.872804 2559 scope.go:117] "RemoveContainer" containerID="38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025" Sep 14 09:38:33.365884 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:33.365853 2559 generic.go:356] "Generic (PLEG): container finished" podID="d25060bf-6260-457f-9974-1124cd4a99fb" containerID="f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4" exitCode=2 Sep 14 09:38:33.366048 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:33.365934 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" event={"ID":"d25060bf-6260-457f-9974-1124cd4a99fb","Type":"ContainerDied","Data":"f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4"} Sep 14 09:38:33.366048 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:33.366002 2559 scope.go:117] "RemoveContainer" containerID="38d53e1f1be4fcf515f9e3e1b79048adb6c1b2eb987828a8b64f046c52dd1025" Sep 14 09:38:33.366317 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:33.366301 2559 scope.go:117] "RemoveContainer" containerID="f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4" Sep 14 09:38:33.366526 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:38:33.366508 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:38:36.195362 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:36.195325 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:38:36.195792 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:36.195386 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" Sep 14 09:38:36.195792 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:36.195748 2559 scope.go:117] "RemoveContainer" containerID="f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4" Sep 14 09:38:36.199345 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:38:36.195934 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:38:45.323814 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:45.323782 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:38:47.873002 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:38:47.872967 2559 scope.go:117] "RemoveContainer" containerID="f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4" Sep 14 09:38:47.873488 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:38:47.873214 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:39:01.811990 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:01.811957 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-846c9b9db5-6v8zs_d25060bf-6260-457f-9974-1124cd4a99fb/manager/4.log" Sep 14 09:39:01.933340 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:01.933307 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hhg5l_152fb40b-4b77-4290-80c8-93cb6964dae7/server/0.log" Sep 14 09:39:02.095977 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:02.095897 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-klb85_ad875c8b-66d0-4bc9-9d24-ece842841e6a/manager/0.log" Sep 14 09:39:02.516376 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:02.516304 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74db9478bb-wlmhb_94715fb3-dd73-44f2-b9c8-a9bda32e604e/copy-manifests/0.log" Sep 14 09:39:02.540374 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:02.540350 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74db9478bb-wlmhb_94715fb3-dd73-44f2-b9c8-a9bda32e604e/manager/0.log" Sep 14 09:39:02.873495 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:02.873466 2559 scope.go:117] "RemoveContainer" containerID="f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4" Sep 14 09:39:02.873893 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:02.873635 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:39:04.129491 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:04.129459 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-gqm9d_0166f61b-38ec-45e6-87d6-f1b373a1a14c/manager/0.log" Sep 14 09:39:04.884885 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:04.884845 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7nknq_ec5362ce-e50c-44bc-a452-8a6154668b7b/discovery/0.log" Sep 14 09:39:11.443549 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:11.443516 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:39:12.035303 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:12.035256 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:39:15.873505 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:15.873476 2559 scope.go:117] "RemoveContainer" containerID="f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4" Sep 14 09:39:15.873960 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:15.873674 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:39:16.243558 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:16.243474 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5q4qs_18c02bfb-afbc-4bfb-994a-bc0bbb71fb7e/global-pull-secret-syncer/0.log" Sep 14 09:39:16.838111 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:16.838084 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" Sep 14 09:39:17.526086 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:17.526059 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-221.ec2.internal_5e8d91d2b5ed7cd579e77961dd0af861/haproxy/0.log" Sep 14 09:39:20.236659 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:20.236626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-gqm9d_0166f61b-38ec-45e6-87d6-f1b373a1a14c/manager/0.log" Sep 14 09:39:22.610611 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:22.610583 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8wnnx_e618b5f4-107d-499e-bba9-2eac6485068a/kube-state-metrics/0.log" Sep 14 09:39:22.728099 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:22.728062 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8wnnx_e618b5f4-107d-499e-bba9-2eac6485068a/kube-rbac-proxy-main/0.log" Sep 14 09:39:22.852898 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:22.852850 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-8wnnx_e618b5f4-107d-499e-bba9-2eac6485068a/kube-rbac-proxy-self/0.log" Sep 14 09:39:23.461775 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:23.461706 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bf8s7_a14a96a3-8256-43d4-98aa-2f5be545137b/node-exporter/0.log" Sep 14 09:39:23.628072 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:23.628049 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bf8s7_a14a96a3-8256-43d4-98aa-2f5be545137b/kube-rbac-proxy/0.log" Sep 14 09:39:23.691536 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:23.691510 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bf8s7_a14a96a3-8256-43d4-98aa-2f5be545137b/init-textfile/0.log" Sep 14 09:39:24.617677 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.617652 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4589ea29-915a-4c4d-912f-9dc3b0d53999/prometheus/0.log" Sep 14 09:39:24.697331 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.697307 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4589ea29-915a-4c4d-912f-9dc3b0d53999/config-reloader/0.log" Sep 14 09:39:24.780989 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.780966 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4589ea29-915a-4c4d-912f-9dc3b0d53999/thanos-sidecar/0.log" Sep 14 09:39:24.847850 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.847821 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4589ea29-915a-4c4d-912f-9dc3b0d53999/kube-rbac-proxy-web/0.log" Sep 14 09:39:24.930760 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.930684 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2"] Sep 14 09:39:24.934058 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.934037 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:24.946179 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:24.946155 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-221.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-hk5jl\": no relationship found between node 'ip-10-0-136-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-hk5jl\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 14 09:39:24.947060 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:24.947038 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-221.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-must-gather-hk5jl\": no relationship found between node 'ip-10-0-136-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-hk5jl\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 14 09:39:24.947113 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:24.947085 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-52h5m\" is forbidden: User \"system:node:ip-10-0-136-221.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-must-gather-hk5jl\": no relationship found between node 'ip-10-0-136-221.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-must-gather-hk5jl\"/\"default-dockercfg-52h5m\"" type="*v1.Secret" Sep 14 09:39:24.969192 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.969167 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4589ea29-915a-4c4d-912f-9dc3b0d53999/kube-rbac-proxy/0.log" Sep 14 09:39:24.998984 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.998948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-lib-modules\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:24.999167 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.998993 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-proc\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:24.999167 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.999019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-podres\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:24.999167 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.999092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-sys\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:24.999167 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:24.999137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jfp8\" (UniqueName: \"kubernetes.io/projected/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-kube-api-access-4jfp8\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.011168 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.011140 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2"] Sep 14 09:39:25.099749 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jfp8\" (UniqueName: \"kubernetes.io/projected/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-kube-api-access-4jfp8\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.099927 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-lib-modules\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.099927 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-proc\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.099927 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099839 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-podres\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.099927 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099857 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-sys\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.100081 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099935 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-sys\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.100081 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099935 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-proc\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.100081 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099991 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-lib-modules\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.100081 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.099992 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-podres\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:25.179617 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.179589 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4589ea29-915a-4c4d-912f-9dc3b0d53999/kube-rbac-proxy-thanos/0.log" Sep 14 09:39:25.265977 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.265899 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4589ea29-915a-4c4d-912f-9dc3b0d53999/init-config-reloader/0.log" Sep 14 09:39:25.421598 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.421552 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjgbf_480e2d27-bdf3-4ddf-8015-60e0fe5e18ec/konnectivity-agent/0.log" limit=1024 Sep 14 09:39:25.799440 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:25.799411 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hk5jl\"/\"openshift-service-ca.crt\"" Sep 14 09:39:26.128280 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:26.128193 2559 projected.go:291] Couldn't get configMap openshift-must-gather-hk5jl/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Sep 14 09:39:26.128280 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:26.128232 2559 projected.go:196] Error preparing data for projected volume kube-api-access-4jfp8 for pod openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2: failed to sync configmap cache: timed out waiting for the condition Sep 14 09:39:26.128505 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:26.128305 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-kube-api-access-4jfp8 podName:8ce32e35-8126-4c65-ba80-f0762d3ed7a7 nodeName:}" failed. No retries permitted until 2026-09-14 09:39:26.628287425 +0000 UTC m=+645.296862504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4jfp8" (UniqueName: "kubernetes.io/projected/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-kube-api-access-4jfp8") pod "perf-node-gather-daemonset-2lmq2" (UID: "8ce32e35-8126-4c65-ba80-f0762d3ed7a7") : failed to sync configmap cache: timed out waiting for the condition Sep 14 09:39:26.265070 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:26.265042 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hk5jl\"/\"kube-root-ca.crt\"" Sep 14 09:39:26.516612 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:26.516531 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hk5jl\"/\"default-dockercfg-52h5m\"" Sep 14 09:39:26.713568 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:26.713530 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jfp8\" (UniqueName: \"kubernetes.io/projected/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-kube-api-access-4jfp8\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:26.716120 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:26.716091 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jfp8\" (UniqueName: \"kubernetes.io/projected/8ce32e35-8126-4c65-ba80-f0762d3ed7a7-kube-api-access-4jfp8\") pod \"perf-node-gather-daemonset-2lmq2\" (UID: \"8ce32e35-8126-4c65-ba80-f0762d3ed7a7\") " pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:26.743605 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:26.743568 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:26.873377 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:26.873345 2559 scope.go:117] "RemoveContainer" containerID="f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4" Sep 14 09:39:26.873768 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:26.873544 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:39:27.035333 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:27.035302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2"] Sep 14 09:39:27.038311 ip-10-0-136-221 kubenswrapper[2559]: W0914 09:39:27.038286 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8ce32e35_8126_4c65_ba80_f0762d3ed7a7.slice/crio-03acc91633ee18885e2f4a5b7db114f759256b3fd8d9c4a2b043fd3f0ca7f80c WatchSource:0}: Error finding container 03acc91633ee18885e2f4a5b7db114f759256b3fd8d9c4a2b043fd3f0ca7f80c: Status 404 returned error can't find the container with id 03acc91633ee18885e2f4a5b7db114f759256b3fd8d9c4a2b043fd3f0ca7f80c Sep 14 09:39:27.609299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:27.609267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" event={"ID":"8ce32e35-8126-4c65-ba80-f0762d3ed7a7","Type":"ContainerStarted","Data":"bfdde43bfd8d7b98948176822351ee39d60db5cba61a34eee6f9708297309f13"} Sep 14 09:39:27.609529 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:27.609322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" event={"ID":"8ce32e35-8126-4c65-ba80-f0762d3ed7a7","Type":"ContainerStarted","Data":"03acc91633ee18885e2f4a5b7db114f759256b3fd8d9c4a2b043fd3f0ca7f80c"} Sep 14 09:39:27.609529 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:27.609409 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:27.664342 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:27.664286 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" podStartSLOduration=3.6642664849999997 podStartE2EDuration="3.664266485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:39:27.663198143 +0000 UTC m=+646.331773244" watchObservedRunningTime="2026-09-14 09:39:27.664266485 +0000 UTC m=+646.332841586" Sep 14 09:39:31.550916 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:31.550887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r5j7t_faa52794-2466-4870-98ec-239ab3ac70b2/dns/0.log" Sep 14 09:39:31.620578 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:31.620552 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r5j7t_faa52794-2466-4870-98ec-239ab3ac70b2/kube-rbac-proxy/0.log" Sep 14 09:39:31.768525 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:31.768403 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q5zms_b85043e0-817d-4fb1-b67b-e5ce2a50adb1/dns-node-resolver/0.log" Sep 14 09:39:32.883917 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:32.883889 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mlfkj_d6d8c6e2-08af-49bd-8210-88043e13a1ca/node-ca/0.log" Sep 14 09:39:33.623640 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:33.623611 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hk5jl/perf-node-gather-daemonset-2lmq2" Sep 14 09:39:34.517396 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:34.517365 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7nknq_ec5362ce-e50c-44bc-a452-8a6154668b7b/discovery/0.log" Sep 14 09:39:35.867044 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:35.867009 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j29rb_fe5b7fed-9d90-43ff-bc7c-0f61c6b7ba99/serve-healthcheck-canary/0.log" Sep 14 09:39:36.487514 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:36.487401 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7nknq_ec5362ce-e50c-44bc-a452-8a6154668b7b/discovery/0.log" Sep 14 09:39:36.958191 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:36.958140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-fgvmq_7b4e400a-913f-4667-bd9d-9dd46b1a6c40/insights-operator/0.log" Sep 14 09:39:37.018935 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:37.018901 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-945xh_5cdd7078-7ad7-4564-991d-4a56301cd656/kube-rbac-proxy/0.log" Sep 14 09:39:37.085141 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:37.085113 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-945xh_5cdd7078-7ad7-4564-991d-4a56301cd656/exporter/0.log" Sep 14 09:39:37.160955 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:37.160925 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-945xh_5cdd7078-7ad7-4564-991d-4a56301cd656/extractor/0.log" Sep 14 09:39:38.037931 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:38.037899 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7nknq_ec5362ce-e50c-44bc-a452-8a6154668b7b/discovery/0.log" Sep 14 09:39:39.873299 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:39.873271 2559 scope.go:117] "RemoveContainer" containerID="f9d7ffce096a69dd7fc06b8a982582e34162301b0c6128aee7184cd2fd140da4" Sep 14 09:39:39.873716 ip-10-0-136-221 kubenswrapper[2559]: E0914 09:39:39.873534 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=maas-controller-846c9b9db5-6v8zs_opendatahub(d25060bf-6260-457f-9974-1124cd4a99fb)\"" pod="opendatahub/maas-controller-846c9b9db5-6v8zs" podUID="d25060bf-6260-457f-9974-1124cd4a99fb" Sep 14 09:39:40.988262 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:40.988236 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-846c9b9db5-6v8zs_d25060bf-6260-457f-9974-1124cd4a99fb/manager/4.log" Sep 14 09:39:40.988679 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:40.988237 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-846c9b9db5-6v8zs_d25060bf-6260-457f-9974-1124cd4a99fb/manager/4.log" Sep 14 09:39:41.124121 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:41.124098 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hhg5l_152fb40b-4b77-4290-80c8-93cb6964dae7/server/0.log" Sep 14 09:39:41.238846 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:41.238767 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-klb85_ad875c8b-66d0-4bc9-9d24-ece842841e6a/manager/0.log" Sep 14 09:39:42.189363 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:42.189331 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74db9478bb-wlmhb_94715fb3-dd73-44f2-b9c8-a9bda32e604e/manager/0.log" Sep 14 09:39:42.307519 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:42.307482 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74db9478bb-wlmhb_94715fb3-dd73-44f2-b9c8-a9bda32e604e/copy-manifests/0.log" Sep 14 09:39:44.027127 ip-10-0-136-221 kubenswrapper[2559]: I0914 09:39:44.027097 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9fbfd6689-zcthx_eefacc06-084d-4a5b-a035-61b66905d592/manager/0.log"